Jul 07 17:10:53 devstack cinder-volume[76079]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 17:10:53 devstack cinder-volume[76079]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:10:53 devstack cinder-volume[76079]: we strongly recommend against using it for new projects. Jul 07 17:10:53 devstack cinder-volume[76079]: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:10:53 devstack cinder-volume[76079]: framework. For more detail see Jul 07 17:10:53 devstack cinder-volume[76079]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:10:53 devstack cinder-volume[76079]: import eventlet # noqa Jul 07 17:10:56 devstack cinder-volume[76079]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76079) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:10:56 devstack cinder-volume[76079]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76079) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:10:56 devstack cinder-volume[76079]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76079) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:10:56 devstack cinder-volume[76079]: INFO dbcounter [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Registered counter for database cinder Jul 07 17:10:57 devstack cinder-volume[76079]: DEBUG oslo_db.sqlalchemy.engines [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76079) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:10:57 devstack cinder-volume[76079]: DEBUG dbcounter [-] [76079] Writer thread running {{(pid=76079) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:10:57 devstack cinder-volume[76079]: INFO cinder.rpc [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 17:10:57 devstack cinder-volume[76079]: INFO cinder.rpc [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 17:10:57 devstack cinder-volume[76079]: DEBUG oslo_db.sqlalchemy.engines [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76079) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:10:57 devstack cinder-volume[76079]: INFO cinder.volume.manager [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Determined volume DB was empty at startup. Jul 07 17:10:57 devstack cinder-volume[76079]: DEBUG cinder.volume.manager [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76079) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 17:10:57 devstack cinder-volume[76079]: INFO cinder.volume.manager [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 17:10:57 devstack cinder-volume[76079]: WARNING stevedore.named [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 17:10:57 devstack cinder-volume[76079]: WARNING castellan.key_manager [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:10:57 devstack cinder-volume[76079]: WARNING cinder.keymgr.conf_key_mgr [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:10:57 devstack cinder-volume[76079]: DEBUG cinder.volume.drivers.lvm [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76079) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 07 17:10:57 devstack cinder-volume[76079]: DEBUG oslo_concurrency.processutils [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76079) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:10:57 devstack cinder-volume[76079]: DEBUG oslo_concurrency.processutils [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] CMD "cinder-rtstool verify" returned: 0 in 0.388s {{(pid=76079) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:10:57 devstack cinder-volume[76079]: DEBUG oslo_db.sqlalchemy.engines [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76079) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:10:57 devstack cinder-volume[76079]: INFO cinder.rpc [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 07 17:10:57 devstack cinder-volume[76079]: INFO cinder.rpc [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 07 17:10:57 devstack cinder-volume[76079]: WARNING stevedore.named [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 17:10:57 devstack cinder-volume[76079]: WARNING castellan.key_manager [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:10:57 devstack cinder-volume[76079]: INFO cinder.volume.manager [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 07 17:10:57 devstack cinder-volume[76079]: DEBUG oslo_db.sqlalchemy.engines [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76079) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:10:58 devstack cinder-volume[76079]: INFO oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Starting 1 workers Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Started child 76232 {{(pid=76079) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Full set of CONF: {{(pid=76079) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] ******************************************************************************** {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Configuration options gathered from: {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 17:10:58 devstack cinder-volume[76232]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] ================================================================================ {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] allow_availability_zone_fallback = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] allow_compression_on_image_upload = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] allowed_direct_url_schemes = [] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] api_rate_limit = True {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] auth_strategy = keystone {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] az_cache_duration = 3600 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_availability_zone = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_host = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_name = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_stats_polling_interval = 60 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backup_api_class = cinder.backup.api.API {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backup_name_template = backup-%s {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backup_use_same_host = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backup_use_temp_snapshot = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] chap_password = **** {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] chap_username = {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cinder_internal_tenant_project_id = b94f4acff424410ca242e076c0d8f519 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cinder_internal_tenant_user_id = 7fb7b57820f14dffbb55c89dca259c86 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cloned_volume_same_az = True {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cluster = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] compression_format = gzip {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] compute_api_class = cinder.compute.nova.API {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] config_dir = [] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] config_source = [] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] control_exchange = openstack {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] debug = True {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] default_availability_zone = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] default_group_type = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] default_volume_type = lvmdriver-1 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] disk_geometry = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] driver_client_cert = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] driver_client_cert_key = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] driver_data_namespace = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] driver_ssl_cert_path = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] driver_ssl_cert_verify = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] driver_use_ssl = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] enable_force_upload = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] enable_new_services = True {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] enable_unsupported_driver = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] enforce_multipath_for_image_xfer = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] filter_function = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] glance_api_insecure = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] glance_api_servers = ['http://192.168.122.114/image'] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] glance_api_ssl_compression = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] glance_ca_certificates_file = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] glance_catalog_info = image:glance:publicURL {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] glance_certfile = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] glance_keyfile = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76232]: INFO cinder.volume.manager [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 07 17:10:58 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] glance_num_retries = 3 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] glance_request_timeout = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] goodness_function = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] graceful_shutdown_timeout = 5 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] group_api_class = cinder.group.api.API {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] host = devstack {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] image_compress_on_upload = True {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] image_conversion_address_space_limit = 1 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] image_conversion_cpu_limit = 60 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] image_conversion_disable = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] image_upload_use_cinder_backend = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] image_upload_use_internal_tenant = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] image_volume_cache_enabled = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] image_volume_cache_max_count = 0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] image_volume_cache_max_size_gb = 0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] init_host_max_objects_retrieval = 0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] instance_format = [instance: %(uuid)s] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] iscsi_target_flags = {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] iscsi_write_cache = on {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] iser_helper = tgtadm {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] iser_ip_address = 192.168.122.114 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] iser_port = 3260 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] log_color = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] log_config_append = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] log_dir = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] log_file = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] log_options = True {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] log_rotate_interval = 1 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] log_rotate_interval_type = days {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] log_rotation_type = none {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] max_age = 0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] max_logfile_count = 30 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] max_logfile_size_mb = 200 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] max_over_subscription_ratio = 20.0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] message_reap_interval = 86400 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] message_ttl = 2592000 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] migration_create_volume_timeout_secs = 300 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] monkey_patch = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] monkey_patch_modules = [] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] my_ip = 192.168.122.114 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] no_snapshot_gb_quota = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] num_iser_scan_tries = 3 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] num_shell_tries = 3 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] num_volume_device_scan_tries = 3 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] nvmeof_conn_info_version = 1 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] nvmet_ns_id = 10 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] nvmet_port_id = 1 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] osapi_max_limit = 1000 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] osapi_volume_ext_list = [] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] osapi_volume_listen_port = 8776 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] osapi_volume_use_ssl = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] osapi_volume_workers = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] per_volume_size_limit = -1 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] periodic_fuzzy_delay = 60 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] periodic_interval = 60 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] public_endpoint = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] publish_errors = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] quota_backup_gigabytes = 1000 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] quota_backups = 10 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] quota_gigabytes = 1000 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] quota_groups = 10 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] quota_snapshots = 10 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] quota_volumes = 10 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] rate_limit_burst = 0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] rate_limit_except_level = CRITICAL {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] rate_limit_interval = 0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] reinit_driver_count = 3 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] replication_device = **** {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] report_discard_supported = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] report_interval = 120 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] reservation_clean_interval = 86400 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] reservation_expire = 86400 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] reserved_image_namespaces = [] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] reserved_percentage = 0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] rpc_response_timeout = 120 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] run_external_periodic_tasks = True {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] scst_target_driver = iscsi {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] scst_target_iqn_name = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] service_down_time = 720 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] shell_completion = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] snapshot_name_template = snapshot-%s {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] snapshot_same_host = True {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] split_loggers = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] state_path = /opt/stack/data/cinder {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] storage_availability_zone = nova {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] storage_protocol = iSCSI {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] syslog_log_facility = LOG_USER {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] target_helper = lioadm {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] target_ip_address = 192.168.122.114 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] target_port = 3260 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] target_protocol = iscsi {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] target_secondary_ip_addresses = [] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] trace_flags = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] transport_url = **** {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] until_refresh = 0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] use_chap_auth = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] use_default_quota_class = True {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] use_journal = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] use_json = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] use_multipath_for_image_xfer = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] use_stderr = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] use_syslog = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] verify_glance_signatures = enabled {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] volume_api_class = cinder.volume.api.API {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] volume_backend_name = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] volume_clear = zero {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] volume_clear_ionice = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] volume_clear_size = 0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] volume_copy_bps_limit = 0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] volume_dd_blocksize = 1M {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] volume_name_template = volume-%s {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] volume_service_inithost_offload = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] volume_usage_audit_period = month {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] zoning_mode = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:10:58 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_concurrency.disable_process_locking = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.auth_section = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.auth_type = password {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.auth_version = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.cache = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.certfile = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.include_service_catalog = True {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.insecure = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.interface = public {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.keyfile = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.memcache_password = {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack sudo[76237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 07 17:10:58 devstack sudo[76237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.memcache_username = {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.region_name = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.service_type = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.114/identity {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.backend = dogpile.cache.null {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.backend_argument = **** {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.backend_expiration_time = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.config_prefix = cache.oslo {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.debug_cache_backend = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.enable_retry_client = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.enable_socket_keepalive = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.enabled = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.expiration_time = 600 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.hashclient_retry_attempts = 2 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.memcache_dead_retry = 300 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.memcache_pool_maxsize = 10 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.memcache_sasl_enabled = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.password = **** {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.proxies = [] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.redis_db = 0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.redis_server = localhost:6379 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.retry_attempts = 2 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.retry_delay = 0.0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.socket_keepalive_count = 1 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.socket_keepalive_idle = 1 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.socket_keepalive_interval = 1 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.socket_timeout = 1.0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.tls_allowed_ciphers = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.tls_cafile = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.tls_certfile = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.tls_enabled = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.tls_keyfile = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cache.username = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] coordination.backend_url = **** {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] database.asyncio_connection = **** {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] database.asyncio_slave_connection = **** {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] database.backend = sqlalchemy {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] database.connection = **** {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] database.connection_debug = 0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] database.connection_parameters = {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] database.connection_recycle_time = 3600 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] database.connection_trace = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] database.db_inc_retry_interval = True {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] database.db_max_retries = 20 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] database.db_max_retry_interval = 10 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] database.db_retry_interval = 1 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] database.max_overflow = 50 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] database.max_pool_size = 5 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] database.max_retries = 10 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] database.mysql_wsrep_sync_wait = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] database.pool_timeout = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] database.retry_interval = 10 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] database.slave_connection = **** {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] database.sqlite_synchronous = True {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] database.synchronous_reader = True {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] database.use_db_reconnect = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] profiler.connection_string = messaging:// {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] profiler.enabled = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] profiler.es_doc_type = notification {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] profiler.es_scroll_size = 10000 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] profiler.es_scroll_time = 2m {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] profiler.filter_error_trace = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] profiler.hmac_keys = **** {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] profiler.sentinel_service_name = mymaster {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] profiler.socket_timeout = 0.1 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] profiler.trace_requests = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] profiler.trace_sqlalchemy = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] profiler_jaeger.process_tags = {} {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] profiler_jaeger.service_name_prefix = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] profiler_otlp.service_name_prefix = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_policy.enforce_new_defaults = True {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_policy.enforce_scope = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_policy.policy_default_rule = default {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_policy.policy_file = policy.yaml {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] privsep_osbrick.group = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] privsep_osbrick.helper_command = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] privsep_osbrick.user = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cinder_sys_admin.group = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cinder_sys_admin.helper_command = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] cinder_sys_admin.user = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] service_user.auth_section = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] service_user.auth_type = password {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] service_user.cafile = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] service_user.certfile = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] service_user.collect_timing = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] service_user.insecure = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] service_user.keyfile = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] service_user.send_service_user_token = True {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] service_user.split_loggers = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] service_user.timeout = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] glance.auth_section = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] glance.auth_type = password {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] glance.certfile = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] glance.collect_timing = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] glance.insecure = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] glance.keyfile = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] glance.region_name = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] glance.split_loggers = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] glance.timeout = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.backend_availability_zone = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.chap_password = **** {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.chap_username = {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.disk_geometry = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.driver_client_cert = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.driver_client_cert_key = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.driver_data_namespace = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.driver_use_ssl = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.extra_capabilities = {} {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.filter_function = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.goodness_function = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.iscsi_target_flags = {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.iscsi_write_cache = on {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.iser_helper = tgtadm {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.iser_ip_address = 192.168.122.114 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.iser_port = 3260 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.lvm_share_target = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.lvm_type = auto {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.num_shell_tries = 3 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.replication_device = **** {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.report_discard_supported = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.reserved_percentage = 0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.target_helper = tgtadm {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.target_ip_address = 192.168.122.114 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.target_port = 3260 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.target_protocol = iscsi {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.trace_flags = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.unique_fqdn_network = True {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.use_chap_auth = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.volume_backend_name = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.volume_clear = zero {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.volume_clear_ionice = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.volume_clear_size = 0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_reports.file_event_handler = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_reports.log_dir = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.backend_host = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.chap_password = **** {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.chap_username = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.disk_geometry = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.driver_client_cert = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.extra_capabilities = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.filter_function = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.goodness_function = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.iser_helper = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.iser_ip_address = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.iser_port = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.lvm_share_target = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.lvm_type = auto {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.num_shell_tries = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.replication_device = **** {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.report_discard_supported = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.reserved_percentage = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.scst_target_driver = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.storage_protocol = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.target_helper = lioadm {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.target_ip_address = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.target_port = 3260 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.trace_flags = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.use_chap_auth = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.volume_clear = zero {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.volume_clear_size = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] lvmdriver-1.volumes_dir = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.ssl = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_notifications.driver = [] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_notifications.retry = -1 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] key_manager.fixed_key = **** {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican.barbican_api_version = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican.barbican_endpoint = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican.barbican_endpoint_type = public {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican.barbican_region_name = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican.cafile = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican.certfile = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican.collect_timing = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican.insecure = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican.keyfile = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican.number_of_retries = 60 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican.retry_delay = 1 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican.send_service_user_token = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican.split_loggers = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican.timeout = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican.verify_ssl = True {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican.verify_ssl_path = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican_service_user.auth_section = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican_service_user.auth_type = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican_service_user.cafile = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican_service_user.certfile = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican_service_user.collect_timing = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican_service_user.insecure = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican_service_user.keyfile = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican_service_user.split_loggers = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] barbican_service_user.timeout = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] vault.approle_role_id = **** {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] vault.approle_secret_id = **** {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] vault.kv_mountpoint = secret {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] vault.kv_path = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] vault.kv_version = 2 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] vault.namespace = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] vault.root_token_id = **** {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] vault.ssl_ca_crt_file = None {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] vault.timeout = 60.0 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] vault.use_ssl = False {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:10:58 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] ******************************************************************************** {{(pid=76079) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 17:10:58 devstack sudo[76237]: pam_unix(sudo:session): session closed for user root Jul 07 17:10:58 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.699s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:10:58 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:10:58 devstack sudo[76242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:10:58 devstack sudo[76242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:10:59 devstack sudo[76242]: pam_unix(sudo:session): session closed for user root Jul 07 17:10:59 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.654s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:10:59 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:10:59 devstack cinder-volume[76232]: INFO cinder.brick.local_dev.lvm [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 07 17:10:59 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:10:59 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:10:59 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:10:59 devstack sudo[76520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:10:59 devstack sudo[76520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:00 devstack sudo[76520]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:00 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:00 devstack cinder-volume[76232]: DEBUG cinder.brick.local_dev.lvm [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76232) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 07 17:11:00 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:00 devstack sudo[76769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:11:00 devstack sudo[76769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:01 devstack sudo[76769]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:01 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.309s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:01 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:01 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:01 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:01 devstack sudo[76985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:11:01 devstack sudo[76985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:02 devstack sudo[76985]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:02 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.694s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:02 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:02 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:02 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:02 devstack sudo[77018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 07 17:11:02 devstack sudo[77018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:03 devstack sudo[77018]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:03 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.832s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:03 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:03 devstack sudo[77021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:11:03 devstack sudo[77021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:03 devstack sudo[77021]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:03 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:03 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:03 devstack sudo[77031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:11:03 devstack sudo[77031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:04 devstack sudo[77031]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:04 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.871s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:04 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:04 devstack sudo[77037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:11:04 devstack sudo[77037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:05 devstack sudo[77037]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:05 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.683s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:05 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:05 devstack sudo[77046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:11:05 devstack sudo[77046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:05 devstack sudo[77046]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:05 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.676s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:05 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:05 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:05 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:06 devstack sudo[77051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:11:06 devstack sudo[77051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:06 devstack sudo[77051]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:06 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.667s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:06 devstack cinder-volume[76232]: INFO cinder.volume.drivers.lvm [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 07 17:11:06 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:06 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:06 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:06 devstack sudo[77056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:11:06 devstack sudo[77056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:07 devstack sudo[77056]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:07 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.791s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:07 devstack cinder-volume[76232]: DEBUG cinder.volume.drivers.lvm [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Updating volume stats {{(pid=76232) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:11:07 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:07 devstack sudo[77173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:11:07 devstack sudo[77173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:08 devstack cinder-volume[76079]: DEBUG dbcounter [-] [76079] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76079) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:11:08 devstack sudo[77173]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:08 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.686s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:08 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:08 devstack sudo[77181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:11:08 devstack sudo[77181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:08 devstack sudo[77181]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:08 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.605s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:08 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:08 devstack sudo[77321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:11:08 devstack sudo[77321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:09 devstack sudo[77321]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:09 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.613s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:09 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:09 devstack sudo[77324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:11:09 devstack sudo[77324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:10 devstack sudo[77324]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:10 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:10 devstack cinder-volume[76232]: INFO cinder.volume.driver [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Driver hasn't implemented _init_vendor_properties() Jul 07 17:11:10 devstack cinder-volume[76232]: DEBUG cinder.volume.driver [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76232) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 17:11:10 devstack cinder-volume[76232]: DEBUG oslo_db.sqlalchemy.engines [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76232) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:11:10 devstack cinder-volume[76232]: DEBUG dbcounter [-] [76232] Writer thread running {{(pid=76232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:11:10 devstack cinder-volume[76232]: DEBUG cinder.db.api [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Building query based on filter {{(pid=76232) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 17:11:10 devstack cinder-volume[76232]: DEBUG cinder.image.image_utils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76232) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 17:11:10 devstack cinder-volume[76232]: INFO cinder.keymgr.migration [None req-d6e47db8-4052-4181-9fc7-17262ad70c3f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 17:11:10 devstack cinder-volume[76232]: DEBUG cinder.volume.drivers.lvm [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Updating volume stats {{(pid=76232) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:11:10 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:10 devstack sudo[77331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:11:10 devstack sudo[77331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:10 devstack sudo[77331]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:10 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:10 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:10 devstack sudo[77337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:11:10 devstack sudo[77337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:11 devstack sudo[77337]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:11 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.609s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:11 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:11 devstack sudo[77340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:11:11 devstack sudo[77340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:12 devstack sudo[77340]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:12 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.673s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:12 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:12 devstack sudo[77343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:11:12 devstack sudo[77343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:12 devstack sudo[77343]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:12 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:12 devstack cinder-volume[76232]: DEBUG cinder.manager [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Notifying Schedulers of capabilities ... {{(pid=76232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:11:12 devstack cinder-volume[76232]: INFO cinder.volume.manager [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Driver initialization completed successfully. Jul 07 17:11:12 devstack cinder-volume[76232]: INFO cinder.manager [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Initiating service 2 cleanup Jul 07 17:11:12 devstack cinder-volume[76232]: INFO cinder.manager [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Service 2 cleanup completed. Jul 07 17:11:12 devstack cinder-volume[76232]: DEBUG cinder.service [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Creating RPC server for service cinder-volume {{(pid=76232) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 17:11:12 devstack cinder-volume[76232]: DEBUG cinder.service [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76232) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 17:11:12 devstack cinder-volume[76232]: INFO cinder.volume.manager [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 07 17:11:12 devstack cinder-volume[76232]: DEBUG cinder.volume.drivers.lvm [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Updating volume stats {{(pid=76232) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:11:12 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:12 devstack sudo[77347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:11:12 devstack sudo[77347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:13 devstack sudo[77347]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:13 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:13 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:13 devstack sudo[77350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:11:13 devstack sudo[77350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:14 devstack sudo[77350]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:14 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:14 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:14 devstack sudo[77357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:11:14 devstack sudo[77357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:14 devstack sudo[77357]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:14 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.735s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:14 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:11:14 devstack sudo[77360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:11:14 devstack sudo[77360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:11:15 devstack sudo[77360]: pam_unix(sudo:session): session closed for user root Jul 07 17:11:15 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.607s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:11:15 devstack cinder-volume[76232]: INFO cinder.volume.manager [None req-88d78c88-4035-4662-9063-7550b995b1f8 None None] Driver post RPC initialization completed successfully. Jul 07 17:11:22 devstack cinder-volume[76232]: DEBUG dbcounter [-] [76232] Writing DB stats cinder:SELECT=2 {{(pid=76232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:11:25 devstack cinder-volume[76232]: DEBUG dbcounter [-] [76232] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:11:54 devstack cinder-volume[76232]: DEBUG oslo_service.periodic_task [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Running periodic task VolumeManager._thread_info {{(pid=76232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:11:54 devstack cinder-volume[76232]: DEBUG cinder.volume.manager [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] thread count: 6 {{(pid=76232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:11:54 devstack cinder-volume[76232]: DEBUG cinder.volume.manager [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] thread info: [<_MainThread(MainThread, started 136423310942336)>, , , , , ] {{(pid=76232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:12:54 devstack cinder-volume[76232]: DEBUG oslo_service.periodic_task [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:12:54 devstack cinder-volume[76232]: DEBUG cinder.volume.drivers.lvm [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Updating volume stats {{(pid=76232) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:12:54 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:12:54 devstack sudo[82320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:12:54 devstack sudo[82320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:12:55 devstack sudo[82320]: pam_unix(sudo:session): session closed for user root Jul 07 17:12:55 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:12:55 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:12:55 devstack sudo[82323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:12:55 devstack sudo[82323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:12:55 devstack sudo[82323]: pam_unix(sudo:session): session closed for user root Jul 07 17:12:55 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:12:55 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:12:55 devstack sudo[82326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:12:55 devstack sudo[82326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:12:56 devstack sudo[82326]: pam_unix(sudo:session): session closed for user root Jul 07 17:12:56 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.621s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:12:56 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:12:56 devstack sudo[82329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:12:56 devstack sudo[82329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:12:57 devstack sudo[82329]: pam_unix(sudo:session): session closed for user root Jul 07 17:12:57 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:12:57 devstack cinder-volume[76232]: DEBUG cinder.manager [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Notifying Schedulers of capabilities ... {{(pid=76232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:12:57 devstack cinder-volume[76232]: DEBUG oslo_service.periodic_task [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Running periodic task VolumeManager._thread_info {{(pid=76232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:12:57 devstack cinder-volume[76232]: DEBUG cinder.volume.manager [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] thread count: 6 {{(pid=76232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:12:57 devstack cinder-volume[76232]: DEBUG cinder.volume.manager [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] thread info: [<_MainThread(MainThread, started 136423310942336)>, , , , , ] {{(pid=76232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:13:25 devstack cinder-volume[76232]: DEBUG dbcounter [-] [76232] Writing DB stats cinder:SELECT=1 {{(pid=76232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:13:25 devstack cinder-volume[76232]: DEBUG dbcounter [-] [76232] Writing DB stats cinder:UPDATE=1 {{(pid=76232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:13:54 devstack cinder-volume[76232]: DEBUG oslo_service.periodic_task [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:13:54 devstack cinder-volume[76232]: DEBUG cinder.volume.drivers.lvm [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Updating volume stats {{(pid=76232) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:13:54 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:13:54 devstack sudo[84140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:13:54 devstack sudo[84140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:13:55 devstack sudo[84140]: pam_unix(sudo:session): session closed for user root Jul 07 17:13:55 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.720s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:13:55 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:13:55 devstack sudo[84145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:13:55 devstack sudo[84145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:13:55 devstack sudo[84145]: pam_unix(sudo:session): session closed for user root Jul 07 17:13:55 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:13:55 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:13:55 devstack sudo[84157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:13:55 devstack sudo[84157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:13:56 devstack sudo[84157]: pam_unix(sudo:session): session closed for user root Jul 07 17:13:56 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.709s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:13:56 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:13:56 devstack sudo[84180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:13:56 devstack sudo[84180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:13:57 devstack sudo[84180]: pam_unix(sudo:session): session closed for user root Jul 07 17:13:57 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:13:57 devstack cinder-volume[76232]: DEBUG cinder.manager [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Notifying Schedulers of capabilities ... {{(pid=76232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:13:57 devstack cinder-volume[76232]: DEBUG oslo_service.periodic_task [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Running periodic task VolumeManager._thread_info {{(pid=76232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:13:57 devstack cinder-volume[76232]: DEBUG cinder.volume.manager [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] thread count: 6 {{(pid=76232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:13:57 devstack cinder-volume[76232]: DEBUG cinder.volume.manager [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] thread info: [<_MainThread(MainThread, started 136423310942336)>, , , , , ] {{(pid=76232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:14:54 devstack cinder-volume[76232]: DEBUG oslo_service.periodic_task [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:14:54 devstack cinder-volume[76232]: DEBUG cinder.volume.drivers.lvm [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Updating volume stats {{(pid=76232) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:14:54 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:14:54 devstack sudo[85470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:14:54 devstack sudo[85470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:14:55 devstack sudo[85470]: pam_unix(sudo:session): session closed for user root Jul 07 17:14:55 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:14:55 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:14:55 devstack sudo[85476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:14:55 devstack sudo[85476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:14:55 devstack sudo[85476]: pam_unix(sudo:session): session closed for user root Jul 07 17:14:55 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:14:55 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:14:55 devstack sudo[85480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:14:55 devstack sudo[85480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:14:56 devstack sudo[85480]: pam_unix(sudo:session): session closed for user root Jul 07 17:14:56 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.617s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:14:56 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:14:56 devstack sudo[85494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:14:56 devstack sudo[85494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:14:57 devstack sudo[85494]: pam_unix(sudo:session): session closed for user root Jul 07 17:14:57 devstack cinder-volume[76232]: DEBUG oslo_concurrency.processutils [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.696s {{(pid=76232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:14:57 devstack cinder-volume[76232]: DEBUG cinder.manager [None req-3be44e3e-f037-4462-9d69-f5243ebb979c None None] Notifying Schedulers of capabilities ... {{(pid=76232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:15:25 devstack cinder-volume[76232]: DEBUG dbcounter [-] [76232] Writing DB stats cinder:SELECT=1 {{(pid=76232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:15:25 devstack cinder-volume[76232]: DEBUG dbcounter [-] [76232] Writing DB stats cinder:UPDATE=1 {{(pid=76232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:15:34 devstack cinder-volume[76079]: INFO oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Caught SIGTERM, stopping children Jul 07 17:15:34 devstack cinder-volume[76079]: DEBUG oslo_concurrency.lockutils [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Acquiring lock "singleton_lock" {{(pid=76079) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:15:34 devstack cinder-volume[76079]: DEBUG oslo_concurrency.lockutils [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Acquired lock "singleton_lock" {{(pid=76079) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:15:34 devstack cinder-volume[76079]: DEBUG oslo_concurrency.lockutils [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Releasing lock "singleton_lock" {{(pid=76079) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:15:34 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Stop services. {{(pid=76079) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 17:15:34 devstack cinder-volume[76079]: DEBUG oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Killing children. {{(pid=76079) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 17:15:34 devstack cinder-volume[76079]: INFO oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Waiting on 1 children to exit Jul 07 17:15:37 devstack cinder-volume[76232]: DEBUG oslo_concurrency.lockutils [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Acquiring lock "singleton_lock" {{(pid=76232) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:15:37 devstack cinder-volume[76232]: DEBUG oslo_concurrency.lockutils [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Acquired lock "singleton_lock" {{(pid=76232) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:15:37 devstack cinder-volume[76232]: DEBUG oslo_concurrency.lockutils [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Releasing lock "singleton_lock" {{(pid=76232) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:15:37 devstack cinder-volume[76232]: WARNING amqp [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 17:15:37 devstack cinder-volume[76232]: WARNING amqp [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 17:15:37 devstack cinder-volume[76079]: INFO oslo_service.backend._eventlet.service [None req-0fd8390e-4111-4c37-bc7f-681ffbf30871 None None] Child 76232 exited with status 0 Jul 07 17:15:38 devstack cinder-volume[86344]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 17:15:38 devstack cinder-volume[86344]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:15:38 devstack cinder-volume[86344]: we strongly recommend against using it for new projects. Jul 07 17:15:38 devstack cinder-volume[86344]: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:15:38 devstack cinder-volume[86344]: framework. For more detail see Jul 07 17:15:38 devstack cinder-volume[86344]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:15:38 devstack cinder-volume[86344]: import eventlet # noqa Jul 07 17:15:40 devstack cinder-volume[86344]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86344) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:15:40 devstack cinder-volume[86344]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86344) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:15:40 devstack cinder-volume[86344]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86344) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:15:41 devstack cinder-volume[86344]: INFO dbcounter [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Registered counter for database cinder Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_db.sqlalchemy.engines [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86344) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG dbcounter [-] [86344] Writer thread running {{(pid=86344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:15:41 devstack cinder-volume[86344]: INFO cinder.rpc [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 17:15:41 devstack cinder-volume[86344]: INFO cinder.rpc [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_db.sqlalchemy.engines [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86344) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:15:41 devstack cinder-volume[86344]: INFO cinder.volume.manager [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Determined volume DB was empty at startup. Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG cinder.volume.manager [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86344) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 17:15:41 devstack cinder-volume[86344]: INFO cinder.volume.manager [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 17:15:41 devstack cinder-volume[86344]: WARNING stevedore.named [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 17:15:41 devstack cinder-volume[86344]: WARNING castellan.key_manager [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:15:41 devstack cinder-volume[86344]: WARNING cinder.keymgr.conf_key_mgr [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:15:41 devstack cinder-volume[86344]: INFO cinder.volume.manager [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_db.sqlalchemy.engines [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86344) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:15:41 devstack cinder-volume[86344]: INFO oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Starting 1 workers Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Started child 86565 {{(pid=86344) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Full set of CONF: {{(pid=86344) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] ******************************************************************************** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Configuration options gathered from: {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] ================================================================================ {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] allow_availability_zone_fallback = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] allow_compression_on_image_upload = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] allowed_direct_url_schemes = [] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] api_rate_limit = True {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] auth_strategy = keystone {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_availability_zone = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_host = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86565]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_name = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_stats_polling_interval = 60 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backup_api_class = cinder.backup.api.API {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backup_name_template = backup-%s {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backup_use_same_host = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backup_use_temp_snapshot = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] chap_password = **** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] chap_username = {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cinder_internal_tenant_project_id = b94f4acff424410ca242e076c0d8f519 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cinder_internal_tenant_user_id = 7fb7b57820f14dffbb55c89dca259c86 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cluster = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] compression_format = gzip {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] compute_api_class = cinder.compute.nova.API {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] config_dir = [] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] config_source = [] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] control_exchange = openstack {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] debug = True {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] default_availability_zone = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] default_group_type = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] default_volume_type = QuobyteHD {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] disk_geometry = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] driver_client_cert = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] driver_client_cert_key = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] driver_data_namespace = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] driver_ssl_cert_path = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] driver_ssl_cert_verify = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] driver_use_ssl = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] enable_new_services = True {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] enable_unsupported_driver = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] enabled_backends = ['QuobyteHD'] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] enforce_multipath_for_image_xfer = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] filter_function = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] glance_api_insecure = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] glance_api_servers = ['http://192.168.122.114/image'] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] glance_api_ssl_compression = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] glance_ca_certificates_file = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] glance_catalog_info = image:glance:publicURL {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] glance_certfile = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] glance_keyfile = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] glance_num_retries = 3 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] glance_request_timeout = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] goodness_function = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] graceful_shutdown_timeout = 5 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] group_api_class = cinder.group.api.API {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] host = devstack {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] image_compress_on_upload = True {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] image_conversion_address_space_limit = 1 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] image_conversion_cpu_limit = 60 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] image_conversion_disable = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] image_upload_use_cinder_backend = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] image_upload_use_internal_tenant = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] image_volume_cache_enabled = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] image_volume_cache_max_count = 0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] image_volume_cache_max_size_gb = 0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] init_host_max_objects_retrieval = 0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] instance_format = [instance: %(uuid)s] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] iscsi_target_flags = {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] iscsi_write_cache = on {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] iser_helper = tgtadm {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] iser_ip_address = 192.168.122.114 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] iser_port = 3260 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] log_color = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] log_config_append = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] log_dir = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] log_file = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] log_options = True {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] log_rotate_interval = 1 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86565]: INFO cinder.volume.manager [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] log_rotate_interval_type = days {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] log_rotation_type = none {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86565]: DEBUG cinder.volume.drivers.remotefs [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86565) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] max_age = 0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] max_logfile_count = 30 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] max_logfile_size_mb = 200 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] max_over_subscription_ratio = 20.0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] message_reap_interval = 86400 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] message_ttl = 2592000 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] migration_create_volume_timeout_secs = 300 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] monkey_patch = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] monkey_patch_modules = [] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] my_ip = 192.168.122.114 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] no_snapshot_gb_quota = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] num_iser_scan_tries = 3 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] num_shell_tries = 3 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] num_volume_device_scan_tries = 3 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] nvmeof_conn_info_version = 1 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] nvmet_ns_id = 10 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] nvmet_port_id = 1 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] osapi_max_limit = 1000 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] osapi_volume_ext_list = [] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] osapi_volume_listen_port = 8776 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] osapi_volume_use_ssl = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] osapi_volume_workers = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] per_volume_size_limit = -1 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] periodic_fuzzy_delay = 60 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] periodic_interval = 60 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] public_endpoint = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] publish_errors = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] quota_backup_gigabytes = 1000 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] quota_backups = 10 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] quota_gigabytes = 1000 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] quota_groups = 10 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] quota_snapshots = 10 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] quota_volumes = 10 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] rate_limit_burst = 0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] rate_limit_except_level = CRITICAL {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] rate_limit_interval = 0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] reinit_driver_count = 3 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] replication_device = **** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] report_discard_supported = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] report_interval = 120 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] reservation_clean_interval = 86400 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] reservation_expire = 86400 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] reserved_image_namespaces = [] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] reserved_percentage = 0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:41 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] rpc_response_timeout = 120 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] run_external_periodic_tasks = True {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] scst_target_driver = iscsi {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] scst_target_iqn_name = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] service_down_time = 720 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] shell_completion = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] snapshot_name_template = snapshot-%s {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] split_loggers = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] state_path = /opt/stack/data/cinder {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] storage_availability_zone = nova {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] storage_protocol = iSCSI {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] syslog_log_facility = LOG_USER {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] target_helper = lioadm {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] target_ip_address = 192.168.122.114 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] target_port = 3260 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] target_protocol = iscsi {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] target_secondary_ip_addresses = [] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] trace_flags = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] transport_url = **** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] until_refresh = 0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] use_chap_auth = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] use_default_quota_class = True {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] use_journal = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] use_json = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] use_multipath_for_image_xfer = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] use_stderr = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] use_syslog = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] verify_glance_signatures = enabled {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] volume_api_class = cinder.volume.api.API {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] volume_backend_name = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] volume_clear = zero {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] volume_clear_ionice = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] volume_clear_size = 0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] volume_copy_bps_limit = 0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] volume_dd_blocksize = 1M {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] volume_name_template = volume-%s {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] volume_service_inithost_offload = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] volume_usage_audit_period = month {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] zoning_mode = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_concurrency.disable_process_locking = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.auth_section = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.auth_type = password {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.auth_version = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.cache = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.certfile = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.include_service_catalog = True {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.insecure = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.interface = public {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.keyfile = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.memcache_password = {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.memcache_username = {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.region_name = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.service_type = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.114/identity {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.backend = dogpile.cache.null {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.backend_argument = **** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.backend_expiration_time = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.config_prefix = cache.oslo {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.debug_cache_backend = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.enable_retry_client = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.enable_socket_keepalive = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.enabled = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.expiration_time = 600 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.hashclient_retry_attempts = 2 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.memcache_dead_retry = 300 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.memcache_pool_maxsize = 10 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.memcache_sasl_enabled = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.password = **** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.proxies = [] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.redis_db = 0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.redis_server = localhost:6379 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.retry_attempts = 2 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.retry_delay = 0.0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.socket_keepalive_count = 1 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.socket_keepalive_idle = 1 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.socket_keepalive_interval = 1 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.socket_timeout = 1.0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.tls_allowed_ciphers = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.tls_cafile = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.tls_certfile = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.tls_enabled = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.tls_keyfile = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cache.username = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] coordination.backend_url = **** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] database.asyncio_connection = **** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] database.asyncio_slave_connection = **** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] database.backend = sqlalchemy {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] database.connection = **** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] database.connection_debug = 0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] database.connection_parameters = {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] database.connection_recycle_time = 3600 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] database.connection_trace = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] database.db_inc_retry_interval = True {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] database.db_max_retries = 20 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] database.db_max_retry_interval = 10 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] database.db_retry_interval = 1 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86565]: DEBUG cinder.volume.drivers.quobyte [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86565) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] database.max_overflow = 50 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86565]: WARNING cinder.volume.drivers.quobyte [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 17:15:42 devstack cinder-volume[86565]: WARNING cinder.volume.drivers.quobyte [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] database.max_pool_size = 5 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] database.max_retries = 10 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] database.mysql_wsrep_sync_wait = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86565]: DEBUG oslo_concurrency.processutils [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Running cmd (subprocess): mount.quobyte {{(pid=86565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] database.pool_timeout = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] database.retry_interval = 10 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] database.slave_connection = **** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] database.sqlite_synchronous = True {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] database.synchronous_reader = True {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] database.use_db_reconnect = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] profiler.connection_string = messaging:// {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] profiler.enabled = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] profiler.es_doc_type = notification {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] profiler.es_scroll_size = 10000 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] profiler.es_scroll_time = 2m {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] profiler.filter_error_trace = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] profiler.hmac_keys = **** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] profiler.sentinel_service_name = mymaster {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] profiler.socket_timeout = 0.1 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] profiler.trace_requests = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] profiler.trace_sqlalchemy = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] profiler_jaeger.process_tags = {} {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] profiler_jaeger.service_name_prefix = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] profiler_otlp.service_name_prefix = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_policy.enforce_new_defaults = True {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_policy.enforce_scope = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_policy.policy_default_rule = default {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_policy.policy_file = policy.yaml {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] privsep_osbrick.group = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] privsep_osbrick.helper_command = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] privsep_osbrick.user = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cinder_sys_admin.group = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cinder_sys_admin.helper_command = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] cinder_sys_admin.user = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] service_user.auth_section = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] service_user.auth_type = password {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] service_user.cafile = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] service_user.certfile = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] service_user.collect_timing = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] service_user.insecure = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] service_user.keyfile = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] service_user.send_service_user_token = True {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] service_user.split_loggers = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] service_user.timeout = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] glance.auth_section = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] glance.auth_type = password {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] glance.certfile = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] glance.collect_timing = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] glance.insecure = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] glance.keyfile = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] glance.region_name = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] glance.split_loggers = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] glance.timeout = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.backend_availability_zone = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.chap_password = **** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.chap_username = {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.disk_geometry = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.driver_client_cert = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.driver_client_cert_key = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.driver_data_namespace = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.driver_use_ssl = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.extra_capabilities = {} {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.filter_function = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.goodness_function = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.iscsi_target_flags = {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.iscsi_write_cache = on {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.iser_helper = tgtadm {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.iser_ip_address = 192.168.122.114 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.iser_port = 3260 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.nas_host = {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.nas_login = admin {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.nas_mount_options = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.nas_password = **** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.nas_private_key = {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.nas_share_path = {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.num_shell_tries = 3 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.quobyte_volume_url = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.replication_device = **** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.report_discard_supported = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.reserved_percentage = 0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.target_helper = tgtadm {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.target_ip_address = 192.168.122.114 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.target_port = 3260 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.target_protocol = iscsi {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.trace_flags = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.unique_fqdn_network = True {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.use_chap_auth = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.volume_backend_name = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.volume_clear = zero {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.volume_clear_ionice = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.volume_clear_size = 0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_reports.file_event_handler = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_reports.log_dir = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.backend_availability_zone = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.backend_host = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.chap_password = **** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.chap_username = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.chiscsi_conf = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.disk_geometry = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.driver_client_cert = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.driver_data_namespace = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.driver_use_ssl = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.extra_capabilities = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.filter_function = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.goodness_function = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack sudo[86569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c -c /etc/quobyte/client-cinder.cfg Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack sudo[86569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:42 devstack cinder-volume[86565]: DEBUG oslo_concurrency.processutils [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] CMD "mount.quobyte" returned: 1 in 0.062s {{(pid=86565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.iser_helper = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86565]: DEBUG oslo_concurrency.lockutils [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86565) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.iser_ip_address = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.iser_port = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86565]: DEBUG oslo_concurrency.lockutils [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86565) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.iser_target_prefix = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86565]: DEBUG cinder.volume.drivers.quobyte [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=86565) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.nas_host = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.nas_login = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86565]: INFO cinder.volume.drivers.quobyte [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 ... Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.nas_mount_options = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86565]: DEBUG oslo_concurrency.processutils [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c -c /etc/quobyte/client-cinder.cfg {{(pid=86565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.nas_password = **** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.nas_private_key = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.nas_share_path = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.nas_ssh_port = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.num_shell_tries = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.nvmet_port_id = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.replication_device = **** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.report_discard_supported = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.reserved_percentage = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.scst_target_driver = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.storage_protocol = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.target_helper = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.target_ip_address = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.target_port = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.target_prefix = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.target_protocol = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.trace_flags = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.use_chap_auth = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.volume_clear = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.volume_clear_size = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] QuobyteHD.volumes_dir = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.ssl = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_notifications.driver = [] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_notifications.retry = -1 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] key_manager.fixed_key = **** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican.barbican_api_version = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican.barbican_endpoint = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican.barbican_endpoint_type = public {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican.barbican_region_name = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican.cafile = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican.certfile = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican.collect_timing = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican.insecure = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican.keyfile = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican.number_of_retries = 60 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican.retry_delay = 1 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican.send_service_user_token = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican.split_loggers = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican.timeout = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican.verify_ssl = True {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican.verify_ssl_path = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican_service_user.auth_section = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican_service_user.auth_type = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican_service_user.cafile = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican_service_user.certfile = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican_service_user.collect_timing = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican_service_user.insecure = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican_service_user.keyfile = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican_service_user.split_loggers = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] barbican_service_user.timeout = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] vault.approle_role_id = **** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] vault.approle_secret_id = **** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] vault.kv_mountpoint = secret {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] vault.kv_path = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] vault.kv_version = 2 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] vault.namespace = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] vault.root_token_id = **** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] vault.ssl_ca_crt_file = None {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] vault.timeout = 60.0 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] vault.use_ssl = False {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:42 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] ******************************************************************************** {{(pid=86344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 17:15:42 devstack sudo[86569]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:42 devstack cinder-volume[86565]: DEBUG oslo_concurrency.processutils [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.728s {{(pid=86565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:42 devstack cinder-volume[86565]: INFO cinder.volume.drivers.quobyte [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 succeeded Jul 07 17:15:42 devstack cinder-volume[86565]: DEBUG cinder.volume.drivers.quobyte [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=86565) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:15:42 devstack cinder-volume[86565]: DEBUG oslo_concurrency.lockutils [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.738s {{(pid=86565) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:15:42 devstack cinder-volume[86565]: DEBUG oslo_concurrency.processutils [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=86565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:42 devstack sudo[86638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:15:42 devstack sudo[86638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:43 devstack sudo[86638]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:43 devstack cinder-volume[86565]: DEBUG oslo_concurrency.processutils [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.596s {{(pid=86565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:43 devstack cinder-volume[86565]: INFO cinder.volume.driver [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Driver hasn't implemented _init_vendor_properties() Jul 07 17:15:43 devstack cinder-volume[86565]: DEBUG cinder.volume.driver [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86565) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 17:15:43 devstack cinder-volume[86565]: DEBUG oslo_db.sqlalchemy.engines [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86565) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:15:43 devstack cinder-volume[86565]: DEBUG dbcounter [-] [86565] Writer thread running {{(pid=86565) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:15:43 devstack cinder-volume[86565]: DEBUG cinder.db.api [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Building query based on filter {{(pid=86565) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 17:15:43 devstack cinder-volume[86565]: DEBUG cinder.image.image_utils [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86565) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 17:15:43 devstack cinder-volume[86565]: INFO cinder.keymgr.migration [None req-043922aa-8d4b-4d96-a7a1-7f29b608b58b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 17:15:43 devstack cinder-volume[86565]: DEBUG oslo_concurrency.lockutils [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86565) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:15:43 devstack cinder-volume[86565]: DEBUG oslo_concurrency.lockutils [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86565) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:15:43 devstack cinder-volume[86565]: DEBUG cinder.volume.drivers.quobyte [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=86565) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:15:43 devstack cinder-volume[86565]: DEBUG cinder.volume.drivers.quobyte [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=86565) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:15:43 devstack cinder-volume[86565]: DEBUG oslo_concurrency.lockutils [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86565) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:15:43 devstack cinder-volume[86565]: DEBUG oslo_concurrency.processutils [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=86565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:43 devstack sudo[86642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:15:43 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:44 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:44 devstack cinder-volume[86565]: DEBUG oslo_concurrency.processutils [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.611s {{(pid=86565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:44 devstack cinder-volume[86565]: DEBUG cinder.manager [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Notifying Schedulers of capabilities ... {{(pid=86565) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:15:44 devstack cinder-volume[86565]: INFO cinder.volume.manager [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Driver initialization completed successfully. Jul 07 17:15:44 devstack cinder-volume[86565]: INFO cinder.manager [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Initiating service 3 cleanup Jul 07 17:15:44 devstack cinder-volume[86565]: INFO cinder.manager [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Service 3 cleanup completed. Jul 07 17:15:44 devstack cinder-volume[86565]: DEBUG cinder.service [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Creating RPC server for service cinder-volume {{(pid=86565) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 17:15:44 devstack cinder-volume[86565]: DEBUG cinder.service [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86565) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 17:15:44 devstack cinder-volume[86565]: INFO cinder.volume.manager [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 17:15:44 devstack cinder-volume[86565]: DEBUG oslo_concurrency.lockutils [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86565) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:15:44 devstack cinder-volume[86565]: DEBUG oslo_concurrency.lockutils [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86565) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:15:44 devstack cinder-volume[86565]: DEBUG cinder.volume.drivers.quobyte [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=86565) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:15:44 devstack cinder-volume[86565]: DEBUG cinder.volume.drivers.quobyte [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=86565) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:15:44 devstack cinder-volume[86565]: DEBUG oslo_concurrency.lockutils [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86565) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:15:44 devstack cinder-volume[86565]: DEBUG oslo_concurrency.processutils [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=86565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:44 devstack sudo[86661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:15:44 devstack sudo[86661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:45 devstack sudo[86661]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:45 devstack cinder-volume[86565]: DEBUG oslo_concurrency.processutils [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.717s {{(pid=86565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:45 devstack cinder-volume[86565]: INFO cinder.volume.manager [None req-f85d7c8f-b8ae-4faf-82a3-b3dc78da11dc None None] Driver post RPC initialization completed successfully. Jul 07 17:15:49 devstack cinder-volume[86565]: DEBUG oslo_concurrency.lockutils [None req-4621b060-265a-4952-a23e-7a43f78a959b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86565) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:15:49 devstack cinder-volume[86565]: DEBUG oslo_concurrency.lockutils [None req-4621b060-265a-4952-a23e-7a43f78a959b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86565) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:15:49 devstack cinder-volume[86565]: DEBUG cinder.volume.drivers.quobyte [None req-4621b060-265a-4952-a23e-7a43f78a959b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=86565) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:15:49 devstack cinder-volume[86565]: DEBUG cinder.volume.drivers.quobyte [None req-4621b060-265a-4952-a23e-7a43f78a959b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=86565) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:15:49 devstack cinder-volume[86565]: DEBUG oslo_concurrency.lockutils [None req-4621b060-265a-4952-a23e-7a43f78a959b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86565) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:15:49 devstack cinder-volume[86565]: DEBUG oslo_concurrency.processutils [None req-4621b060-265a-4952-a23e-7a43f78a959b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=86565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:49 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:15:49 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:50 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Jul 07 17:15:50 devstack cinder-volume[86565]: DEBUG oslo_concurrency.processutils [None req-4621b060-265a-4952-a23e-7a43f78a959b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.627s {{(pid=86565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:50 devstack cinder-volume[86565]: DEBUG cinder.manager [None req-4621b060-265a-4952-a23e-7a43f78a959b None None] Notifying Schedulers of capabilities ... {{(pid=86565) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:15:51 devstack cinder-volume[86344]: INFO oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Caught SIGTERM, stopping children Jul 07 17:15:51 devstack cinder-volume[86344]: DEBUG oslo_concurrency.lockutils [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Acquiring lock "singleton_lock" {{(pid=86344) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:15:51 devstack cinder-volume[86344]: DEBUG oslo_concurrency.lockutils [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Acquired lock "singleton_lock" {{(pid=86344) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:15:51 devstack cinder-volume[86344]: DEBUG oslo_concurrency.lockutils [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Releasing lock "singleton_lock" {{(pid=86344) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:15:51 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Stop services. {{(pid=86344) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 17:15:51 devstack cinder-volume[86344]: DEBUG oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Killing children. {{(pid=86344) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 17:15:51 devstack cinder-volume[86344]: INFO oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Waiting on 1 children to exit Jul 07 17:15:52 devstack cinder-volume[86565]: DEBUG oslo_concurrency.lockutils [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Acquiring lock "singleton_lock" {{(pid=86565) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:15:52 devstack cinder-volume[86565]: DEBUG oslo_concurrency.lockutils [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Acquired lock "singleton_lock" {{(pid=86565) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:15:52 devstack cinder-volume[86565]: DEBUG oslo_concurrency.lockutils [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Releasing lock "singleton_lock" {{(pid=86565) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:15:52 devstack cinder-volume[86565]: WARNING amqp [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 17:15:52 devstack cinder-volume[86565]: WARNING amqp [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 17:15:52 devstack cinder-volume[86344]: INFO oslo_service.backend._eventlet.service [None req-8b735cc3-c553-4480-97a9-9f8ca7a7bd03 None None] Child 86565 exited with status 0 Jul 07 17:15:53 devstack cinder-volume[86995]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 17:15:53 devstack cinder-volume[86995]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:15:53 devstack cinder-volume[86995]: we strongly recommend against using it for new projects. Jul 07 17:15:53 devstack cinder-volume[86995]: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:15:53 devstack cinder-volume[86995]: framework. For more detail see Jul 07 17:15:53 devstack cinder-volume[86995]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:15:53 devstack cinder-volume[86995]: import eventlet # noqa Jul 07 17:15:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86995) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:15:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86995) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:15:56 devstack cinder-volume[86995]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86995) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:15:57 devstack cinder-volume[86995]: INFO dbcounter [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] Registered counter for database cinder Jul 07 17:15:57 devstack cinder-volume[86995]: DEBUG oslo_db.sqlalchemy.engines [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86995) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:15:57 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writer thread running {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:15:57 devstack cinder-volume[86995]: INFO cinder.rpc [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 17:15:57 devstack cinder-volume[86995]: INFO cinder.rpc [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 17:15:57 devstack cinder-volume[86995]: DEBUG oslo_db.sqlalchemy.engines [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86995) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:15:58 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] Determined volume DB was empty at startup. Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG cinder.volume.manager [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86995) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 17:15:58 devstack cinder-volume[86995]: WARNING stevedore.named [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 17:15:58 devstack cinder-volume[86995]: WARNING castellan.key_manager [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:15:58 devstack cinder-volume[86995]: WARNING cinder.keymgr.conf_key_mgr [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:15:58 devstack cinder-volume[86995]: INFO cinder.volume.manager [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_db.sqlalchemy.engines [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86995) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:15:58 devstack cinder-volume[86995]: INFO oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] Starting 1 workers Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] Started child 87303 {{(pid=86995) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] Full set of CONF: {{(pid=86995) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] ******************************************************************************** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] Configuration options gathered from: {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] ================================================================================ {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] allow_availability_zone_fallback = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] allow_compression_on_image_upload = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] allowed_direct_url_schemes = [] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] api_rate_limit = True {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] auth_strategy = keystone {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_availability_zone = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_host = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_name = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_stats_polling_interval = 60 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backup_api_class = cinder.backup.api.API {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backup_name_template = backup-%s {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backup_use_same_host = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backup_use_temp_snapshot = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] chap_password = **** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] chap_username = {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cinder_internal_tenant_project_id = b94f4acff424410ca242e076c0d8f519 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cinder_internal_tenant_user_id = 7fb7b57820f14dffbb55c89dca259c86 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cluster = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] compression_format = gzip {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] compute_api_class = cinder.compute.nova.API {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[87303]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] config_dir = [] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] config_source = [] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] control_exchange = openstack {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] debug = True {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] default_availability_zone = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] default_group_type = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] default_volume_type = QuobyteHD {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] disk_geometry = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] driver_client_cert = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] driver_client_cert_key = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] driver_data_namespace = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] driver_ssl_cert_path = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] driver_ssl_cert_verify = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] driver_use_ssl = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] enable_new_services = True {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] enable_unsupported_driver = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] enabled_backends = ['QuobyteHD'] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] enforce_multipath_for_image_xfer = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] filter_function = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] glance_api_insecure = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] glance_api_servers = ['http://192.168.122.114/image'] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] glance_api_ssl_compression = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] glance_ca_certificates_file = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] glance_catalog_info = image:glance:publicURL {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] glance_certfile = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] glance_keyfile = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] glance_num_retries = 3 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] glance_request_timeout = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] goodness_function = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] graceful_shutdown_timeout = 5 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] group_api_class = cinder.group.api.API {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] host = devstack {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] image_compress_on_upload = True {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] image_conversion_address_space_limit = 1 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] image_conversion_cpu_limit = 60 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] image_conversion_disable = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] image_upload_use_cinder_backend = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] image_upload_use_internal_tenant = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] image_volume_cache_enabled = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] image_volume_cache_max_count = 0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] image_volume_cache_max_size_gb = 0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] init_host_max_objects_retrieval = 0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] instance_format = [instance: %(uuid)s] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] iscsi_target_flags = {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] iscsi_write_cache = on {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] iser_helper = tgtadm {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] iser_ip_address = 192.168.122.114 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] iser_port = 3260 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] log_color = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] log_config_append = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] log_dir = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] log_file = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] log_options = True {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] log_rotate_interval = 1 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] log_rotate_interval_type = days {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] log_rotation_type = none {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] max_age = 0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] max_logfile_count = 30 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] max_logfile_size_mb = 200 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] max_over_subscription_ratio = 20.0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] message_reap_interval = 86400 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] message_ttl = 2592000 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] migration_create_volume_timeout_secs = 300 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] monkey_patch = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] monkey_patch_modules = [] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] my_ip = 192.168.122.114 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] no_snapshot_gb_quota = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] num_iser_scan_tries = 3 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] num_shell_tries = 3 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] num_volume_device_scan_tries = 3 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] nvmeof_conn_info_version = 1 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] nvmet_ns_id = 10 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] nvmet_port_id = 1 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] osapi_max_limit = 1000 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] osapi_volume_ext_list = [] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] osapi_volume_listen = 0.0.0.0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] osapi_volume_listen_port = 8776 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] osapi_volume_use_ssl = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] osapi_volume_workers = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] per_volume_size_limit = -1 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] periodic_fuzzy_delay = 60 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] periodic_interval = 60 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] project_id_regex = [0-9a-f\-]+ {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] public_endpoint = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] publish_errors = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] quota_backup_gigabytes = 1000 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] quota_backups = 10 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] quota_gigabytes = 1000 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] quota_groups = 10 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] quota_snapshots = 10 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] quota_volumes = 10 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] rate_limit_burst = 0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] rate_limit_except_level = CRITICAL {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] rate_limit_interval = 0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] reinit_driver_count = 3 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] replication_device = **** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] report_discard_supported = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] report_interval = 120 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] reservation_clean_interval = 86400 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] reservation_expire = 86400 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] reserved_image_namespaces = [] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] reserved_percentage = 0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] rpc_response_timeout = 120 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] run_external_periodic_tasks = True {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] scst_target_driver = iscsi {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] scst_target_iqn_name = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] service_down_time = 720 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] shell_completion = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] snapshot_name_template = snapshot-%s {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 17:15:58 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87303) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] split_loggers = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] state_path = /opt/stack/data/cinder {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] storage_availability_zone = nova {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] storage_protocol = iSCSI {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] syslog_log_facility = LOG_USER {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] target_helper = lioadm {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] target_ip_address = 192.168.122.114 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] target_port = 3260 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] target_protocol = iscsi {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] target_secondary_ip_addresses = [] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] trace_flags = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] transfer_api_class = cinder.transfer.api.API {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack sudo[87308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] transport_url = **** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] until_refresh = 0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] use_chap_auth = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] use_default_quota_class = True {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] use_journal = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] use_json = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] use_multipath_for_image_xfer = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack sudo[87308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] use_stderr = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] use_syslog = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] verify_glance_signatures = enabled {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] volume_api_class = cinder.volume.api.API {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] volume_backend_name = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] volume_clear = zero {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] volume_clear_ionice = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] volume_clear_size = 0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] volume_copy_bps_limit = 0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] volume_dd_blocksize = 1M {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] volume_name_template = volume-%s {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] volume_service_inithost_offload = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] volume_usage_audit_period = month {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] zoning_mode = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_concurrency.disable_process_locking = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.auth_section = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.auth_type = password {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:58 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.auth_version = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.cache = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.certfile = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.delay_auth_decision = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.http_connect_timeout = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.include_service_catalog = True {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.insecure = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.interface = public {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.keyfile = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.memcache_password = {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.memcache_username = {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.region_name = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.service_token_roles_required = True {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.service_type = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.token_cache_time = 300 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.114/identity {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.backend = dogpile.cache.null {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.backend_argument = **** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.backend_expiration_time = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.config_prefix = cache.oslo {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.debug_cache_backend = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.enable_retry_client = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.enable_socket_keepalive = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.enabled = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.expiration_time = 600 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.hashclient_retry_attempts = 2 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.memcache_dead_retry = 300 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.memcache_pool_maxsize = 10 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.memcache_sasl_enabled = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.password = **** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.proxies = [] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.redis_db = 0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.redis_sentinel_service_name = mymaster {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.redis_server = localhost:6379 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.retry_attempts = 2 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.retry_delay = 0.0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.socket_keepalive_count = 1 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.socket_keepalive_idle = 1 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.socket_keepalive_interval = 1 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.socket_timeout = 1.0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.tls_allowed_ciphers = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.tls_cafile = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.tls_certfile = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.tls_enabled = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.tls_keyfile = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cache.username = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] coordination.backend_url = **** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] database.asyncio_connection = **** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] database.asyncio_slave_connection = **** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] database.backend = sqlalchemy {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] database.connection = **** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] database.connection_debug = 0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] database.connection_parameters = {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] database.connection_recycle_time = 3600 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] database.connection_trace = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] database.db_inc_retry_interval = True {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] database.db_max_retries = 20 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] database.db_max_retry_interval = 10 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] database.db_retry_interval = 1 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] database.max_overflow = 50 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] database.max_pool_size = 5 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] database.max_retries = 10 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] database.mysql_wsrep_sync_wait = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] database.pool_timeout = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] database.retry_interval = 10 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] database.slave_connection = **** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] database.sqlite_synchronous = True {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] database.synchronous_reader = True {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] database.use_db_reconnect = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] profiler.connection_string = messaging:// {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] profiler.enabled = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] profiler.es_doc_type = notification {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] profiler.es_scroll_size = 10000 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] profiler.es_scroll_time = 2m {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] profiler.filter_error_trace = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] profiler.hmac_keys = **** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] profiler.sentinel_service_name = mymaster {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] profiler.socket_timeout = 0.1 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] profiler.trace_requests = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] profiler.trace_sqlalchemy = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] profiler_jaeger.process_tags = {} {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] profiler_jaeger.service_name_prefix = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] profiler_otlp.service_name_prefix = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_policy.enforce_new_defaults = True {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_policy.enforce_scope = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_policy.policy_default_rule = default {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_policy.policy_file = policy.yaml {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_policy.remote_timeout = 60.0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] privsep_osbrick.group = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] privsep_osbrick.helper_command = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] privsep_osbrick.user = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87303) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cinder_sys_admin.group = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cinder_sys_admin.helper_command = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] cinder_sys_admin.user = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.quobyte [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 17:15:59 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.quobyte [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] service_user.auth_section = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] service_user.auth_type = password {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] service_user.cafile = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] service_user.certfile = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Running cmd (subprocess): mount.quobyte {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] service_user.collect_timing = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] service_user.insecure = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] service_user.keyfile = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] service_user.send_service_user_token = True {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] service_user.split_loggers = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] service_user.timeout = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] glance.auth_section = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] glance.auth_type = password {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] glance.certfile = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] glance.collect_timing = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] glance.insecure = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] glance.keyfile = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] glance.region_name = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] glance.split_loggers = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] glance.timeout = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.backend_availability_zone = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.chap_password = **** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.chap_username = {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.disk_geometry = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.driver_client_cert = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.driver_client_cert_key = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.driver_data_namespace = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.driver_use_ssl = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.enable_unsupported_driver = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.extra_capabilities = {} {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.filter_function = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.goodness_function = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.iscsi_target_flags = {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.iscsi_write_cache = on {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.iser_helper = tgtadm {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.iser_ip_address = 192.168.122.114 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.iser_port = 3260 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.nas_host = {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.nas_login = admin {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.nas_mount_options = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.nas_password = **** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.nas_private_key = {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.nas_share_path = {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.nas_ssh_port = 22 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.num_shell_tries = 3 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.nvmet_port_id = 1 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.quobyte_client_cfg = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.quobyte_volume_url = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.replication_device = **** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.report_discard_supported = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.reserved_percentage = 0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.scst_target_driver = iscsi {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.scst_target_iqn_name = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.storage_protocol = iSCSI {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.target_helper = tgtadm {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.target_ip_address = 192.168.122.114 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.target_port = 3260 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.target_protocol = iscsi {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.trace_flags = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.unique_fqdn_network = True {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.use_chap_auth = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.volume_backend_name = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.volume_clear = zero {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.volume_clear_ionice = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.volume_clear_size = 0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_reports.file_event_handler = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_reports.log_dir = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.backend_availability_zone = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.backend_host = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.chap_password = **** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.chap_username = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.chiscsi_conf = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.disk_geometry = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.driver_client_cert = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.driver_client_cert_key = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.driver_data_namespace = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.driver_use_ssl = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.extra_capabilities = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.filter_function = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.goodness_function = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.iscsi_target_flags = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.iscsi_write_cache = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.iser_helper = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.iser_ip_address = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.iser_port = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.iser_target_prefix = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.nas_host = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.nas_login = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.nas_mount_options = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.nas_password = **** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.nas_private_key = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.nas_share_path = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.nas_ssh_port = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.num_shell_tries = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.nvmet_ns_id = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.nvmet_port_id = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.replication_device = **** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.report_discard_supported = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] CMD "mount.quobyte" returned: 1 in 0.132s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.reserved_percentage = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.scst_target_driver = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.storage_protocol = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.target_helper = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.target_ip_address = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.target_port = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.target_prefix = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.target_protocol = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.trace_flags = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.unique_fqdn_network = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.use_chap_auth = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:15:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:15:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.volume_clear = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.volume_clear_ionice = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.volume_clear_size = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] QuobyteHD.volumes_dir = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:15:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:15:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.ssl = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.ssl_version = {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_notifications.driver = [] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_notifications.retry = -1 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] oslo_messaging_notifications.transport_url = **** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] key_manager.fixed_key = **** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican.barbican_api_version = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican.barbican_endpoint = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican.barbican_endpoint_type = public {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican.barbican_region_name = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican.cafile = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican.certfile = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican.collect_timing = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican.insecure = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican.keyfile = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican.number_of_retries = 60 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican.retry_delay = 1 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican.send_service_user_token = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican.split_loggers = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican.timeout = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican.verify_ssl = True {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican.verify_ssl_path = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican_service_user.auth_section = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican_service_user.auth_type = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican_service_user.cafile = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican_service_user.certfile = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican_service_user.collect_timing = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican_service_user.insecure = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican_service_user.keyfile = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican_service_user.split_loggers = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] barbican_service_user.timeout = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] vault.approle_role_id = **** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] vault.approle_secret_id = **** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] vault.kv_mountpoint = secret {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] vault.kv_path = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] vault.kv_version = 2 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] vault.namespace = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] vault.root_token_id = **** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] vault.ssl_ca_crt_file = None {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] vault.timeout = 60.0 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] vault.use_ssl = False {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:15:59 devstack cinder-volume[86995]: DEBUG oslo_service.backend._eventlet.service [None req-23c6da41-f5e6-4ab4-a47e-ebebc5c771ab None None] ******************************************************************************** {{(pid=86995) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 17:16:00 devstack sudo[87308]: pam_unix(sudo:session): session closed for user root Jul 07 17:16:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.235s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:16:00 devstack cinder-volume[87303]: INFO cinder.volume.driver [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Driver hasn't implemented _init_vendor_properties() Jul 07 17:16:00 devstack cinder-volume[87303]: DEBUG cinder.volume.driver [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87303) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 17:16:00 devstack cinder-volume[87303]: DEBUG oslo_db.sqlalchemy.engines [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87303) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:16:00 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writer thread running {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:16:00 devstack cinder-volume[87303]: DEBUG cinder.db.api [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Building query based on filter {{(pid=87303) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 17:16:00 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87303) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 17:16:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:16:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:16:00 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:16:00 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:16:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:16:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:16:00 devstack cinder-volume[87303]: INFO cinder.keymgr.migration [None req-d3307d40-1cda-4dab-9fda-6ed9ba24b98c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 17:16:00 devstack sudo[87317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:16:00 devstack sudo[87317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:16:00 devstack sudo[87317]: pam_unix(sudo:session): session closed for user root Jul 07 17:16:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.624s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:16:00 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:16:00 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Driver initialization completed successfully. Jul 07 17:16:00 devstack cinder-volume[87303]: INFO cinder.manager [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Initiating service 3 cleanup Jul 07 17:16:00 devstack cinder-volume[87303]: INFO cinder.manager [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Service 3 cleanup completed. Jul 07 17:16:00 devstack cinder-volume[87303]: DEBUG cinder.service [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Creating RPC server for service cinder-volume {{(pid=87303) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 17:16:00 devstack cinder-volume[87303]: DEBUG cinder.service [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87303) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 17:16:00 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 17:16:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:16:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:16:00 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:16:00 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:16:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:16:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:16:00 devstack sudo[87321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:16:00 devstack sudo[87321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:16:01 devstack sudo[87321]: pam_unix(sudo:session): session closed for user root Jul 07 17:16:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.671s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:16:01 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-9344a1ab-57f1-4144-ac25-2a665ff4631c None None] Driver post RPC initialization completed successfully. Jul 07 17:16:08 devstack cinder-volume[86995]: DEBUG dbcounter [-] [86995] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86995) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:16:10 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=2 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:16:11 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:16:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:16:56 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 6 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:16:56 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:17:25 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:17:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Flow 'volume_create_manager' (fdcd28dd-2b5b-40a9-aec3-2e248d384556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:17:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c1c924-fbb1-4f7a-a64d-6f12a063d931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:17:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c1c924-fbb1-4f7a-a64d-6f12a063d931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-105220982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6252dc87-4bea-4c68-a844-bcb542ac820d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe721753c0c4974a8777967a2d6fb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:17:25Z,use_quota=True,user_id='d5cdc49ec5564df9b5507503e7e0ca22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:17:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29dc4913-2559-4f2b-91ad-d82a2d9b91f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:17:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29dc4913-2559-4f2b-91ad-d82a2d9b91f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:17:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be26e28f-37e4-4dce-8924-a402bbd143e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:17:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be26e28f-37e4-4dce-8924-a402bbd143e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6252dc87-4bea-4c68-a844-bcb542ac820d', 'volume_name': 'volume-6252dc87-4bea-4c68-a844-bcb542ac820d', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:17:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657ff0b4-bec3-48a3-8cb4-36a5f81b572c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:17:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657ff0b4-bec3-48a3-8cb4-36a5f81b572c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:17:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f98a004-428a-40ae-a8fd-8efdb2c87eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:17:25 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Volume 6252dc87-4bea-4c68-a844-bcb542ac820d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6252dc87-4bea-4c68-a844-bcb542ac820d', 'volume_size': 1} Jul 07 17:17:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:17:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:17:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-105220982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6252dc87-4bea-4c68-a844-bcb542ac820d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe721753c0c4974a8777967a2d6fb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:17:25Z,use_quota=True,user_id='d5cdc49ec5564df9b5507503e7e0ca22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:17:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Creating volume 6252dc87-4bea-4c68-a844-bcb542ac820d {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:17:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:17:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:17:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:17:26 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:17:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:17:26 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:17:26 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:17:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6252dc87-4bea-4c68-a844-bcb542ac820d 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:17:26 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6252dc87-4bea-4c68-a844-bcb542ac820d 1073741824 Jul 07 17:17:26 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:17:27 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:17:27 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Flow 'volume_create_manager' (d65b4225-7ff3-465a-9985-d030dd5624a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:17:27 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a601d8f0-f7d3-4638-bd9d-735a7f8d0f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:17:27 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a601d8f0-f7d3-4638-bd9d-735a7f8d0f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1759403679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23875e4f-7730-45e3-b94b-a77c731f3907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ed99a16c454e75b992d29ee4cb291a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:17:28Z,use_quota=True,user_id='638df84bf593474899c4b92db938563e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:17:27 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ba5e93-0e27-4497-a613-10d32c6654a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:17:27 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ba5e93-0e27-4497-a613-10d32c6654a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:17:27 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c3a556-4039-42e0-adca-5753759d7fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:17:27 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c3a556-4039-42e0-adca-5753759d7fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23875e4f-7730-45e3-b94b-a77c731f3907', 'volume_name': 'volume-23875e4f-7730-45e3-b94b-a77c731f3907', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:17:27 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d5c338-25f8-40c2-b76c-749ee1768796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:17:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d5c338-25f8-40c2-b76c-749ee1768796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:17:28 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Jul 07 17:17:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5a9aa6-8788-4917-bb79-c5bab478c7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:17:28 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Volume 23875e4f-7730-45e3-b94b-a77c731f3907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23875e4f-7730-45e3-b94b-a77c731f3907', 'volume_size': 1} Jul 07 17:17:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:17:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6252dc87-4bea-4c68-a844-bcb542ac820d 1073741824" returned: 0 in 2.005s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:17:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6252dc87-4bea-4c68-a844-bcb542ac820d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:17:28 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6252dc87-4bea-4c68-a844-bcb542ac820d Jul 07 17:17:28 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:17:30 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Jul 07 17:17:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6252dc87-4bea-4c68-a844-bcb542ac820d" returned: 0 in 1.864s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:17:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] <== create_volume: return (4085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:17:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.104s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:17:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.087s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:17:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1759403679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23875e4f-7730-45e3-b94b-a77c731f3907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ed99a16c454e75b992d29ee4cb291a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:17:28Z,use_quota=True,user_id='638df84bf593474899c4b92db938563e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:17:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Creating volume 23875e4f-7730-45e3-b94b-a77c731f3907 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:17:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:17:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:17:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:17:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:17:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:17:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:17:30 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:17:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-23875e4f-7730-45e3-b94b-a77c731f3907 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:17:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f98a004-428a-40ae-a8fd-8efdb2c87eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6252dc87-4bea-4c68-a844-bcb542ac820d', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:17:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4be122-e0d5-4cdb-91bb-97924f4c2a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:17:30 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-23875e4f-7730-45e3-b94b-a77c731f3907 1073741824 Jul 07 17:17:30 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:17:30 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Volume volume-6252dc87-4bea-4c68-a844-bcb542ac820d (6252dc87-4bea-4c68-a844-bcb542ac820d): created successfully Jul 07 17:17:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4be122-e0d5-4cdb-91bb-97924f4c2a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:17:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Flow 'volume_create_manager' (fdcd28dd-2b5b-40a9-aec3-2e248d384556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:17:30 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-e5170fe8-6416-4846-b036-7fac76bf6754 tempest-DeleteServersTestJSON-1134233501 None] Created volume successfully. Jul 07 17:17:31 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:17:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Flow 'volume_create_manager' (cf497587-6007-4288-8727-32c92c36c152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:17:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6b87af-c2fb-4e52-927f-7e6ecf3c4b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:17:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6b87af-c2fb-4e52-927f-7e6ecf3c4b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1945742206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a941c6-e50d-4248-b9a3-0aaa8817c3e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2949716a75d4e1d8365eec5205964a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:17:31Z,use_quota=True,user_id='7f6520dca6c04e91900bebd2e0f3c859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:17:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343c401a-a2b1-46ff-9480-1691c421ddc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:17:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343c401a-a2b1-46ff-9480-1691c421ddc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:17:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f3eb89-ad76-4944-9c60-d2b1ace4e370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:17:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f3eb89-ad76-4944-9c60-d2b1ace4e370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9a941c6-e50d-4248-b9a3-0aaa8817c3e3', 'volume_name': 'volume-b9a941c6-e50d-4248-b9a3-0aaa8817c3e3', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:17:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf2eb68f-6955-4458-a207-2e47129ee3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:17:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf2eb68f-6955-4458-a207-2e47129ee3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:17:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2483e19-4cfd-4ea9-a449-12342545f77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:17:31 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Volume b9a941c6-e50d-4248-b9a3-0aaa8817c3e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9a941c6-e50d-4248-b9a3-0aaa8817c3e3', 'volume_size': 1} Jul 07 17:17:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:17:31 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Jul 07 17:17:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-23875e4f-7730-45e3-b94b-a77c731f3907 1073741824" returned: 0 in 1.812s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:17:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-23875e4f-7730-45e3-b94b-a77c731f3907 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:17:32 devstack sudo[88407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-23875e4f-7730-45e3-b94b-a77c731f3907 Jul 07 17:17:32 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:17:33 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root Jul 07 17:17:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-23875e4f-7730-45e3-b94b-a77c731f3907" returned: 0 in 1.308s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:17:33 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] <== create_volume: return (3271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:17:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.297s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:17:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.693s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:17:33 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1945742206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a941c6-e50d-4248-b9a3-0aaa8817c3e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2949716a75d4e1d8365eec5205964a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:17:31Z,use_quota=True,user_id='7f6520dca6c04e91900bebd2e0f3c859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:17:33 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Creating volume b9a941c6-e50d-4248-b9a3-0aaa8817c3e3 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:17:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:17:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:17:33 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:17:33 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:17:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:17:33 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:17:33 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:17:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b9a941c6-e50d-4248-b9a3-0aaa8817c3e3 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:17:33 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b9a941c6-e50d-4248-b9a3-0aaa8817c3e3 1073741824 Jul 07 17:17:33 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:17:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5a9aa6-8788-4917-bb79-c5bab478c7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23875e4f-7730-45e3-b94b-a77c731f3907', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:17:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15fbfc1-b877-4491-ba9f-c0c91fcee8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:17:33 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Volume volume-23875e4f-7730-45e3-b94b-a77c731f3907 (23875e4f-7730-45e3-b94b-a77c731f3907): created successfully Jul 07 17:17:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15fbfc1-b877-4491-ba9f-c0c91fcee8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:17:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Flow 'volume_create_manager' (d65b4225-7ff3-465a-9985-d030dd5624a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:17:33 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-80abede4-d19b-4a00-b77c-2de289b8c57c tempest-VolumesAdminNegativeTest-1767050555 None] Created volume successfully. Jul 07 17:17:35 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Jul 07 17:17:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b9a941c6-e50d-4248-b9a3-0aaa8817c3e3 1073741824" returned: 0 in 2.350s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:17:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b9a941c6-e50d-4248-b9a3-0aaa8817c3e3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:17:35 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b9a941c6-e50d-4248-b9a3-0aaa8817c3e3 Jul 07 17:17:36 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:17:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] Acquiring lock "cinder-23875e4f-7730-45e3-b94b-a77c731f3907-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:17:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] Lock "cinder-23875e4f-7730-45e3-b94b-a77c731f3907-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:17:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] Acquiring lock "cinder-quobyte-23875e4f-7730-45e3-b94b-a77c731f3907" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:17:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] Lock "cinder-quobyte-23875e4f-7730-45e3-b94b-a77c731f3907" acquired by "delete_volume" :: waited 0.060s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:17:36 devstack cinder-volume[87303]: INFO oslo.privsep.daemon [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpy5q6xvgu/privsep.sock'] Jul 07 17:17:36 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpy5q6xvgu/privsep.sock Jul 07 17:17:36 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:17:38 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Jul 07 17:17:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b9a941c6-e50d-4248-b9a3-0aaa8817c3e3" returned: 0 in 2.162s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:17:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] <== create_volume: return (4650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:17:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.664s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:17:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2483e19-4cfd-4ea9-a449-12342545f77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9a941c6-e50d-4248-b9a3-0aaa8817c3e3', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:17:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18b0fbd-29bc-47b6-a76e-ed981e5770e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:17:38 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Volume volume-b9a941c6-e50d-4248-b9a3-0aaa8817c3e3 (b9a941c6-e50d-4248-b9a3-0aaa8817c3e3): created successfully Jul 07 17:17:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18b0fbd-29bc-47b6-a76e-ed981e5770e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:17:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Flow 'volume_create_manager' (cf497587-6007-4288-8727-32c92c36c152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:17:38 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-8d54c442-c900-49cb-acb4-34ebbef7df0d tempest-ServerRescueNegativeTestJSON-478886006 None] Created volume successfully. Jul 07 17:17:38 devstack cinder-volume[87303]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 07 17:17:38 devstack cinder-volume[87303]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:17:38 devstack cinder-volume[87303]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 17:17:38 devstack cinder-volume[87303]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 17:17:38 devstack cinder-volume[87303]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:17:38 devstack cinder-volume[87303]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 17:17:38 devstack cinder-volume[87303]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:17:38 devstack cinder-volume[87303]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 17:17:38 devstack cinder-volume[87303]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 07 17:17:40 devstack cinder-volume[87303]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 07 17:17:40 devstack cinder-volume[87303]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:17:40 devstack cinder-volume[87303]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 17:17:40 devstack cinder-volume[87303]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 17:17:40 devstack cinder-volume[87303]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:17:40 devstack cinder-volume[87303]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 17:17:40 devstack cinder-volume[87303]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:17:40 devstack cinder-volume[87303]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 17:17:40 devstack cinder-volume[87303]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 07 17:17:42 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Jul 07 17:17:42 devstack cinder-volume[87303]: INFO oslo.privsep.daemon [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] Spawned new privsep daemon via rootwrap Jul 07 17:17:42 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] Accepted privsep connection to /tmp/tmpy5q6xvgu/privsep.sock {{(pid=87303) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 07 17:17:42 devstack cinder-volume[87303]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 07 17:17:42 devstack cinder-volume[87303]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 07 17:17:42 devstack cinder-volume[87303]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 07 17:17:42 devstack cinder-volume[87303]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88432 Jul 07 17:17:42 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19ab82a-9270-4f18-aa04-0767ee8a3e35]: (2,) {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:17:42 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ab5627-cb1f-4354-a3bd-3e15da6f2777]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:17:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-23875e4f-7730-45e3-b94b-a77c731f3907 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:17:42 devstack cinder-volume[87303]: WARNING py.warnings [req-2ded6049-548a-45f0-aa8e-d3203aaec6f4 req-bc53ab8b-d319-48fd-8ba2-77196319ee04 tempest-DeleteServersTestJSON-1134233501 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 07 17:17:42 devstack cinder-volume[87303]: .first() Jul 07 17:17:42 devstack cinder-volume[87303]: Jul 07 17:17:42 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-23875e4f-7730-45e3-b94b-a77c731f3907 Jul 07 17:17:42 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:17:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-2ded6049-548a-45f0-aa8e-d3203aaec6f4 req-bc53ab8b-d319-48fd-8ba2-77196319ee04 tempest-DeleteServersTestJSON-1134233501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:17:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-2ded6049-548a-45f0-aa8e-d3203aaec6f4 req-bc53ab8b-d319-48fd-8ba2-77196319ee04 tempest-DeleteServersTestJSON-1134233501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:17:42 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b49078-a257-4cf5-b19b-82ffa88f3ffa]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:17:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-2ded6049-548a-45f0-aa8e-d3203aaec6f4 req-bc53ab8b-d319-48fd-8ba2-77196319ee04 tempest-DeleteServersTestJSON-1134233501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6252dc87-4bea-4c68-a844-bcb542ac820d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:17:42 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6252dc87-4bea-4c68-a844-bcb542ac820d Jul 07 17:17:42 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:17:44 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Jul 07 17:17:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-23875e4f-7730-45e3-b94b-a77c731f3907" returned: 0 in 1.917s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:17:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-23875e4f-7730-45e3-b94b-a77c731f3907 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:17:44 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-23875e4f-7730-45e3-b94b-a77c731f3907 Jul 07 17:17:44 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:17:44 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Jul 07 17:17:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-2ded6049-548a-45f0-aa8e-d3203aaec6f4 req-bc53ab8b-d319-48fd-8ba2-77196319ee04 tempest-DeleteServersTestJSON-1134233501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6252dc87-4bea-4c68-a844-bcb542ac820d" returned: 0 in 1.827s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:17:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-2ded6049-548a-45f0-aa8e-d3203aaec6f4 req-bc53ab8b-d319-48fd-8ba2-77196319ee04 tempest-DeleteServersTestJSON-1134233501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.879s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:17:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-2ded6049-548a-45f0-aa8e-d3203aaec6f4 req-bc53ab8b-d319-48fd-8ba2-77196319ee04 tempest-DeleteServersTestJSON-1134233501 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2', 'name': 'volume-6252dc87-4bea-4c68-a844-bcb542ac820d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f5d02fe-1bb4-4fc0-85dd-cb25a7ce6a5c', 'enforce_multipath': True} {{(pid=87303) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:17:44 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-2ded6049-548a-45f0-aa8e-d3203aaec6f4 req-bc53ab8b-d319-48fd-8ba2-77196319ee04 tempest-DeleteServersTestJSON-1134233501 None] attachment_update completed successfully. Jul 07 17:17:46 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Jul 07 17:17:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-23875e4f-7730-45e3-b94b-a77c731f3907" returned: 0 in 1.963s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:17:46 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] Lock "cinder-quobyte-23875e4f-7730-45e3-b94b-a77c731f3907" released by "delete_volume" :: held 9.571s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:17:46 devstack cinder-volume[87303]: WARNING cinder.quota [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:17:46 devstack cinder-volume[87303]: WARNING cinder.quota [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:17:46 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] Created reservations ['a3d66063-e75e-404b-a111-6164e3d51112', '22cb1f77-80d2-43de-8a97-5f09cda92bb8', '1cc5c711-cb12-4768-b1ad-93589e8b0c4a', '5356bfd1-c681-4a5a-be1a-05a1a252dff5'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:17:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:17:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:17:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:17:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:17:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:17:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:17:46 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:17:46 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:17:48 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Jul 07 17:17:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.815s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:17:48 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:17:48 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] Deleted volume successfully. Jul 07 17:17:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-debb25b0-df53-4fe2-9432-7ff00e741218 tempest-VolumesAdminNegativeTest-1767050555 None] Lock "cinder-23875e4f-7730-45e3-b94b-a77c731f3907-delete_volume" released by "delete_volume" :: held 12.008s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:17:56 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=15,cinder:UPDATE=17,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:17:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:17:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:17:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:17:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:17:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:17:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:17:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:17:56 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:17:56 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:17:56 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-6e594dfb-3a64-4de8-bf5f-8219b891f577 req-dda617ed-aeaa-44e1-84bf-d8a8b64472f5 tempest-DeleteServersTestJSON-1134233501 None] Terminate volume connection completed successfully. Jul 07 17:17:56 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-6e594dfb-3a64-4de8-bf5f-8219b891f577 req-dda617ed-aeaa-44e1-84bf-d8a8b64472f5 tempest-DeleteServersTestJSON-1134233501 None] Deleting attachment 9f5d02fe-1bb4-4fc0-85dd-cb25a7ce6a5c. {{(pid=87303) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:17:57 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Jul 07 17:17:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.773s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:17:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:17:57 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:17:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 8 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:17:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:18:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f4492fab-cc5f-4888-9bcd-038ad896dfff tempest-ServerRescueNegativeTestJSON-478886006 None] Acquiring lock "cinder-b9a941c6-e50d-4248-b9a3-0aaa8817c3e3-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:18:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f4492fab-cc5f-4888-9bcd-038ad896dfff tempest-ServerRescueNegativeTestJSON-478886006 None] Lock "cinder-b9a941c6-e50d-4248-b9a3-0aaa8817c3e3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:18:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f4492fab-cc5f-4888-9bcd-038ad896dfff tempest-ServerRescueNegativeTestJSON-478886006 None] Acquiring lock "cinder-quobyte-b9a941c6-e50d-4248-b9a3-0aaa8817c3e3" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:18:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f4492fab-cc5f-4888-9bcd-038ad896dfff tempest-ServerRescueNegativeTestJSON-478886006 None] Lock "cinder-quobyte-b9a941c6-e50d-4248-b9a3-0aaa8817c3e3" acquired by "delete_volume" :: waited 0.043s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:18:03 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c4fa93-9557-4fdb-ad83-1912484a8129]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:18:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f4492fab-cc5f-4888-9bcd-038ad896dfff tempest-ServerRescueNegativeTestJSON-478886006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b9a941c6-e50d-4248-b9a3-0aaa8817c3e3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d4465b51-7a4e-48c8-aeb1-90f7774d1f6e tempest-DeleteServersTestJSON-1134233501 None] Acquiring lock "cinder-6252dc87-4bea-4c68-a844-bcb542ac820d-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:18:03 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b9a941c6-e50d-4248-b9a3-0aaa8817c3e3 Jul 07 17:18:03 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d4465b51-7a4e-48c8-aeb1-90f7774d1f6e tempest-DeleteServersTestJSON-1134233501 None] Lock "cinder-6252dc87-4bea-4c68-a844-bcb542ac820d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:18:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d4465b51-7a4e-48c8-aeb1-90f7774d1f6e tempest-DeleteServersTestJSON-1134233501 None] Acquiring lock "cinder-quobyte-6252dc87-4bea-4c68-a844-bcb542ac820d" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:18:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d4465b51-7a4e-48c8-aeb1-90f7774d1f6e tempest-DeleteServersTestJSON-1134233501 None] Lock "cinder-quobyte-6252dc87-4bea-4c68-a844-bcb542ac820d" acquired by "delete_volume" :: waited 0.029s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:18:03 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdec4c6c-5cde-4d31-9366-2ca04d9f6e9e]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:18:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d4465b51-7a4e-48c8-aeb1-90f7774d1f6e tempest-DeleteServersTestJSON-1134233501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6252dc87-4bea-4c68-a844-bcb542ac820d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:04 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6252dc87-4bea-4c68-a844-bcb542ac820d Jul 07 17:18:04 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:04 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f4492fab-cc5f-4888-9bcd-038ad896dfff tempest-ServerRescueNegativeTestJSON-478886006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b9a941c6-e50d-4248-b9a3-0aaa8817c3e3" returned: 0 in 1.437s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f4492fab-cc5f-4888-9bcd-038ad896dfff tempest-ServerRescueNegativeTestJSON-478886006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b9a941c6-e50d-4248-b9a3-0aaa8817c3e3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:04 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b9a941c6-e50d-4248-b9a3-0aaa8817c3e3 Jul 07 17:18:04 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:05 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d4465b51-7a4e-48c8-aeb1-90f7774d1f6e tempest-DeleteServersTestJSON-1134233501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6252dc87-4bea-4c68-a844-bcb542ac820d" returned: 0 in 2.197s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d4465b51-7a4e-48c8-aeb1-90f7774d1f6e tempest-DeleteServersTestJSON-1134233501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6252dc87-4bea-4c68-a844-bcb542ac820d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:05 devstack sudo[89108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6252dc87-4bea-4c68-a844-bcb542ac820d Jul 07 17:18:05 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:06 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f4492fab-cc5f-4888-9bcd-038ad896dfff tempest-ServerRescueNegativeTestJSON-478886006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b9a941c6-e50d-4248-b9a3-0aaa8817c3e3" returned: 0 in 1.401s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f4492fab-cc5f-4888-9bcd-038ad896dfff tempest-ServerRescueNegativeTestJSON-478886006 None] Lock "cinder-quobyte-b9a941c6-e50d-4248-b9a3-0aaa8817c3e3" released by "delete_volume" :: held 2.926s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:18:06 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-f4492fab-cc5f-4888-9bcd-038ad896dfff tempest-ServerRescueNegativeTestJSON-478886006 None] Created reservations ['4c402dba-8e39-40e2-aea6-4145baf09363', '079e35f9-0a1c-47fe-9713-3db007576aa2', '0a7ebc95-9efb-45ba-b1e0-9f3d73f7ad09', '605296b7-42a1-4a1c-9e0d-cd68daf3cb52'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:18:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f4492fab-cc5f-4888-9bcd-038ad896dfff tempest-ServerRescueNegativeTestJSON-478886006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:18:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f4492fab-cc5f-4888-9bcd-038ad896dfff tempest-ServerRescueNegativeTestJSON-478886006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:18:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f4492fab-cc5f-4888-9bcd-038ad896dfff tempest-ServerRescueNegativeTestJSON-478886006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:18:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f4492fab-cc5f-4888-9bcd-038ad896dfff tempest-ServerRescueNegativeTestJSON-478886006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:18:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f4492fab-cc5f-4888-9bcd-038ad896dfff tempest-ServerRescueNegativeTestJSON-478886006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:18:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f4492fab-cc5f-4888-9bcd-038ad896dfff tempest-ServerRescueNegativeTestJSON-478886006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:06 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:18:06 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:07 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d4465b51-7a4e-48c8-aeb1-90f7774d1f6e tempest-DeleteServersTestJSON-1134233501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6252dc87-4bea-4c68-a844-bcb542ac820d" returned: 0 in 1.722s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d4465b51-7a4e-48c8-aeb1-90f7774d1f6e tempest-DeleteServersTestJSON-1134233501 None] Lock "cinder-quobyte-6252dc87-4bea-4c68-a844-bcb542ac820d" released by "delete_volume" :: held 4.051s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:18:07 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-d4465b51-7a4e-48c8-aeb1-90f7774d1f6e tempest-DeleteServersTestJSON-1134233501 None] Created reservations ['97df5f8a-a767-42d4-8ad9-f0bc819f9124', 'f9f4593b-cf9a-4b85-813c-104604a2af44', 'd1f8430b-4cdd-4352-83b6-4f970a2ae7bb', 'fc31cbad-a528-4924-9f05-0a742b0097f5'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:18:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d4465b51-7a4e-48c8-aeb1-90f7774d1f6e tempest-DeleteServersTestJSON-1134233501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:18:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d4465b51-7a4e-48c8-aeb1-90f7774d1f6e tempest-DeleteServersTestJSON-1134233501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:18:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d4465b51-7a4e-48c8-aeb1-90f7774d1f6e tempest-DeleteServersTestJSON-1134233501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:18:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d4465b51-7a4e-48c8-aeb1-90f7774d1f6e tempest-DeleteServersTestJSON-1134233501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:18:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d4465b51-7a4e-48c8-aeb1-90f7774d1f6e tempest-DeleteServersTestJSON-1134233501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:18:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d4465b51-7a4e-48c8-aeb1-90f7774d1f6e tempest-DeleteServersTestJSON-1134233501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:07 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:18:07 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:08 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f4492fab-cc5f-4888-9bcd-038ad896dfff tempest-ServerRescueNegativeTestJSON-478886006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.676s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:08 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-f4492fab-cc5f-4888-9bcd-038ad896dfff tempest-ServerRescueNegativeTestJSON-478886006 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:18:08 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-f4492fab-cc5f-4888-9bcd-038ad896dfff tempest-ServerRescueNegativeTestJSON-478886006 None] Deleted volume successfully. Jul 07 17:18:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f4492fab-cc5f-4888-9bcd-038ad896dfff tempest-ServerRescueNegativeTestJSON-478886006 None] Lock "cinder-b9a941c6-e50d-4248-b9a3-0aaa8817c3e3-delete_volume" released by "delete_volume" :: held 4.976s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:18:09 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d4465b51-7a4e-48c8-aeb1-90f7774d1f6e tempest-DeleteServersTestJSON-1134233501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.575s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:09 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-d4465b51-7a4e-48c8-aeb1-90f7774d1f6e tempest-DeleteServersTestJSON-1134233501 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:18:09 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-d4465b51-7a4e-48c8-aeb1-90f7774d1f6e tempest-DeleteServersTestJSON-1134233501 None] Deleted volume successfully. Jul 07 17:18:09 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d4465b51-7a4e-48c8-aeb1-90f7774d1f6e tempest-DeleteServersTestJSON-1134233501 None] Lock "cinder-6252dc87-4bea-4c68-a844-bcb542ac820d-delete_volume" released by "delete_volume" :: held 6.042s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:18:18 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=11,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:18:19 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:UPDATE=37,cinder:SELECT=30,cinder:INSERT=9,cinder:DELETE=4 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:18:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:18:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:18:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:18:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:18:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:18:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:18:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:56 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:18:56 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:18:57 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Jul 07 17:18:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.068s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:18:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:18:59 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:18:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Flow 'volume_create_manager' (13e4ad14-bde6-4d50-ba91-a4de3f6379c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:18:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9252a45a-5b8a-41e9-bc07-975d070a41b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9252a45a-5b8a-41e9-bc07-975d070a41b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1880112624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=370d5bba-99c8-4e0b-86a3-25a4bf69fc91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c30b5e5c5a948e48e7e5efff8fcba4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:18:59Z,use_quota=True,user_id='1ddfa14719534c3ea4a0f4593b543944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d01faf6-b32c-448c-99c7-fb936cc1756a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d01faf6-b32c-448c-99c7-fb936cc1756a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450a43b4-afc7-42be-ad3c-1a65f049f8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450a43b4-afc7-42be-ad3c-1a65f049f8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '370d5bba-99c8-4e0b-86a3-25a4bf69fc91', 'volume_name': 'volume-370d5bba-99c8-4e0b-86a3-25a4bf69fc91', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cd39c1-fd25-46a9-9d77-88dc06bc89dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cd39c1-fd25-46a9-9d77-88dc06bc89dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:18:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f53c47b-e8cd-4c98-9042-c7026dfc7f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:18:59 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Volume 370d5bba-99c8-4e0b-86a3-25a4bf69fc91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-370d5bba-99c8-4e0b-86a3-25a4bf69fc91', 'volume_size': 1} Jul 07 17:18:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:18:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:18:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1880112624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=370d5bba-99c8-4e0b-86a3-25a4bf69fc91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c30b5e5c5a948e48e7e5efff8fcba4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:18:59Z,use_quota=True,user_id='1ddfa14719534c3ea4a0f4593b543944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:18:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Creating volume 370d5bba-99c8-4e0b-86a3-25a4bf69fc91 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:18:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:18:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:18:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:18:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:18:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:18:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:18:59 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:18:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-370d5bba-99c8-4e0b-86a3-25a4bf69fc91 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:18:59 devstack sudo[89449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-370d5bba-99c8-4e0b-86a3-25a4bf69fc91 1073741824 Jul 07 17:18:59 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:01 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-370d5bba-99c8-4e0b-86a3-25a4bf69fc91 1073741824" returned: 0 in 1.459s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-370d5bba-99c8-4e0b-86a3-25a4bf69fc91 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:01 devstack sudo[89459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-370d5bba-99c8-4e0b-86a3-25a4bf69fc91 Jul 07 17:19:01 devstack sudo[89459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:02 devstack sudo[89459]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-370d5bba-99c8-4e0b-86a3-25a4bf69fc91" returned: 0 in 1.114s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:02 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] <== create_volume: return (2653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:19:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.659s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:19:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f53c47b-e8cd-4c98-9042-c7026dfc7f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-370d5bba-99c8-4e0b-86a3-25a4bf69fc91', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6952d4f7-a379-49b1-aba4-5738294d51d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:02 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Volume volume-370d5bba-99c8-4e0b-86a3-25a4bf69fc91 (370d5bba-99c8-4e0b-86a3-25a4bf69fc91): created successfully Jul 07 17:19:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6952d4f7-a379-49b1-aba4-5738294d51d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Flow 'volume_create_manager' (13e4ad14-bde6-4d50-ba91-a4de3f6379c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:19:02 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-d8c6122b-304d-403f-9cc7-58aa89d267dd tempest-TaggedAttachmentsTest-980876671 None] Created volume successfully. Jul 07 17:19:09 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:19:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Flow 'volume_create_manager' (e61e0338-fe2b-47ae-b72d-3ea5d7a413df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:19:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41938e9a-6e07-4536-aa71-99d1215cbb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41938e9a-6e07-4536-aa71-99d1215cbb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-108001606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c39ea13-cc56-4c0b-af95-2163243fe6bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c756b26b052643d1a82795f026071cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:19:09Z,use_quota=True,user_id='6211bdfab8ae40beae32c904f474c5bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22f33c2-6b78-41f8-aaa1-59821bf803d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22f33c2-6b78-41f8-aaa1-59821bf803d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b5dba9-545d-42d3-9998-14061c49f1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b5dba9-545d-42d3-9998-14061c49f1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c39ea13-cc56-4c0b-af95-2163243fe6bc', 'volume_name': 'volume-5c39ea13-cc56-4c0b-af95-2163243fe6bc', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44090e3-f1cf-4b14-9093-ac041f4c41ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44090e3-f1cf-4b14-9093-ac041f4c41ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b4c012-8105-44fd-a321-28b4a1746226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:09 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Volume 5c39ea13-cc56-4c0b-af95-2163243fe6bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c39ea13-cc56-4c0b-af95-2163243fe6bc', 'volume_size': 1} Jul 07 17:19:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:19:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:19:09 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-108001606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c39ea13-cc56-4c0b-af95-2163243fe6bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c756b26b052643d1a82795f026071cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:19:09Z,use_quota=True,user_id='6211bdfab8ae40beae32c904f474c5bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:19:09 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Creating volume 5c39ea13-cc56-4c0b-af95-2163243fe6bc {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:19:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:19:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:19:09 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:19:09 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:19:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:19:09 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:19:09 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:19:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5c39ea13-cc56-4c0b-af95-2163243fe6bc 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:09 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5c39ea13-cc56-4c0b-af95-2163243fe6bc 1073741824 Jul 07 17:19:09 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:10 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5c39ea13-cc56-4c0b-af95-2163243fe6bc 1073741824" returned: 0 in 0.902s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5c39ea13-cc56-4c0b-af95-2163243fe6bc {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:10 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5c39ea13-cc56-4c0b-af95-2163243fe6bc Jul 07 17:19:10 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:10 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5c39ea13-cc56-4c0b-af95-2163243fe6bc" returned: 0 in 0.688s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:19:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:19:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b4c012-8105-44fd-a321-28b4a1746226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c39ea13-cc56-4c0b-af95-2163243fe6bc', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c504a2-4d5a-443a-a377-b6673bb60ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:10 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Volume volume-5c39ea13-cc56-4c0b-af95-2163243fe6bc (5c39ea13-cc56-4c0b-af95-2163243fe6bc): created successfully Jul 07 17:19:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c504a2-4d5a-443a-a377-b6673bb60ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Flow 'volume_create_manager' (e61e0338-fe2b-47ae-b72d-3ea5d7a413df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:19:11 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-3ab2c72f-3980-4967-bdca-49cab492af62 tempest-ServersNegativeTestJSON-1436033101 None] Created volume successfully. Jul 07 17:19:13 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:19:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Flow 'volume_create_manager' (ba709920-09fa-4d43-bc28-63580a502419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:19:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2073639-c2b5-49c3-81f4-66c88f9a8811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2073639-c2b5-49c3-81f4-66c88f9a8811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1536513311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f918fa-86ef-4c7f-b7f1-35b871a3b59a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c756b26b052643d1a82795f026071cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:19:14Z,use_quota=True,user_id='6211bdfab8ae40beae32c904f474c5bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c8a45c0-ed96-473b-bcf0-8116e80d6671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c8a45c0-ed96-473b-bcf0-8116e80d6671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef4219a-70fe-4a88-95bd-406afc553a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef4219a-70fe-4a88-95bd-406afc553a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21f918fa-86ef-4c7f-b7f1-35b871a3b59a', 'volume_name': 'volume-21f918fa-86ef-4c7f-b7f1-35b871a3b59a', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de271c0-46fa-4adf-8752-24b54b06b319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de271c0-46fa-4adf-8752-24b54b06b319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b85b7b9e-f327-4275-bc5f-c9bc2dbcc120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:13 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Volume 21f918fa-86ef-4c7f-b7f1-35b871a3b59a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21f918fa-86ef-4c7f-b7f1-35b871a3b59a', 'volume_size': 1} Jul 07 17:19:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:19:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:19:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1536513311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f918fa-86ef-4c7f-b7f1-35b871a3b59a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c756b26b052643d1a82795f026071cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:19:14Z,use_quota=True,user_id='6211bdfab8ae40beae32c904f474c5bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:19:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Creating volume 21f918fa-86ef-4c7f-b7f1-35b871a3b59a {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:19:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:19:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:19:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:19:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:19:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:19:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:19:14 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:19:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-21f918fa-86ef-4c7f-b7f1-35b871a3b59a 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:14 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-21f918fa-86ef-4c7f-b7f1-35b871a3b59a 1073741824 Jul 07 17:19:14 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:14 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-21f918fa-86ef-4c7f-b7f1-35b871a3b59a 1073741824" returned: 0 in 0.942s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-21f918fa-86ef-4c7f-b7f1-35b871a3b59a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:15 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-21f918fa-86ef-4c7f-b7f1-35b871a3b59a Jul 07 17:19:15 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:15 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-21f918fa-86ef-4c7f-b7f1-35b871a3b59a" returned: 0 in 0.714s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:19:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:19:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b85b7b9e-f327-4275-bc5f-c9bc2dbcc120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21f918fa-86ef-4c7f-b7f1-35b871a3b59a', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c86f23-cf54-4af6-b971-257b7569c4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:15 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Volume volume-21f918fa-86ef-4c7f-b7f1-35b871a3b59a (21f918fa-86ef-4c7f-b7f1-35b871a3b59a): created successfully Jul 07 17:19:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c86f23-cf54-4af6-b971-257b7569c4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Flow 'volume_create_manager' (ba709920-09fa-4d43-bc28-63580a502419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:19:15 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-21aaec24-0282-47cc-8b39-a4d6e2ad85f6 tempest-ServersNegativeTestJSON-1436033101 None] Created volume successfully. Jul 07 17:19:16 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f45c1d8e-708d-4702-b07c-79c014cce218 tempest-ServersNegativeTestJSON-1436033101 None] Acquiring lock "cinder-21f918fa-86ef-4c7f-b7f1-35b871a3b59a-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:19:16 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f45c1d8e-708d-4702-b07c-79c014cce218 tempest-ServersNegativeTestJSON-1436033101 None] Lock "cinder-21f918fa-86ef-4c7f-b7f1-35b871a3b59a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:19:16 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f45c1d8e-708d-4702-b07c-79c014cce218 tempest-ServersNegativeTestJSON-1436033101 None] Acquiring lock "cinder-quobyte-21f918fa-86ef-4c7f-b7f1-35b871a3b59a" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:19:16 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f45c1d8e-708d-4702-b07c-79c014cce218 tempest-ServersNegativeTestJSON-1436033101 None] Lock "cinder-quobyte-21f918fa-86ef-4c7f-b7f1-35b871a3b59a" acquired by "delete_volume" :: waited 0.017s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:19:16 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[76df34b7-fa6c-4cb0-a28d-27b89b29c2de]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:19:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f45c1d8e-708d-4702-b07c-79c014cce218 tempest-ServersNegativeTestJSON-1436033101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-21f918fa-86ef-4c7f-b7f1-35b871a3b59a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:16 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-21f918fa-86ef-4c7f-b7f1-35b871a3b59a Jul 07 17:19:16 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:18 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f45c1d8e-708d-4702-b07c-79c014cce218 tempest-ServersNegativeTestJSON-1436033101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-21f918fa-86ef-4c7f-b7f1-35b871a3b59a" returned: 0 in 1.486s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f45c1d8e-708d-4702-b07c-79c014cce218 tempest-ServersNegativeTestJSON-1436033101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-21f918fa-86ef-4c7f-b7f1-35b871a3b59a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:18 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-21f918fa-86ef-4c7f-b7f1-35b871a3b59a Jul 07 17:19:18 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:19 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f45c1d8e-708d-4702-b07c-79c014cce218 tempest-ServersNegativeTestJSON-1436033101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-21f918fa-86ef-4c7f-b7f1-35b871a3b59a" returned: 0 in 1.221s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f45c1d8e-708d-4702-b07c-79c014cce218 tempest-ServersNegativeTestJSON-1436033101 None] Lock "cinder-quobyte-21f918fa-86ef-4c7f-b7f1-35b871a3b59a" released by "delete_volume" :: held 2.769s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:19:19 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-f45c1d8e-708d-4702-b07c-79c014cce218 tempest-ServersNegativeTestJSON-1436033101 None] Created reservations ['f652c435-d743-4b07-9b1a-d892dbe8967f', 'a2b4ee96-9770-4ab8-a0f8-0f4453cabf82', '3793ddd2-b2b8-4fa1-bc37-636ab119cb34', '9f1e4f66-6415-48fa-8316-33b9ecb84c94'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:19:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f45c1d8e-708d-4702-b07c-79c014cce218 tempest-ServersNegativeTestJSON-1436033101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:19:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f45c1d8e-708d-4702-b07c-79c014cce218 tempest-ServersNegativeTestJSON-1436033101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:19:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f45c1d8e-708d-4702-b07c-79c014cce218 tempest-ServersNegativeTestJSON-1436033101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:19:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f45c1d8e-708d-4702-b07c-79c014cce218 tempest-ServersNegativeTestJSON-1436033101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:19:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f45c1d8e-708d-4702-b07c-79c014cce218 tempest-ServersNegativeTestJSON-1436033101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:19:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f45c1d8e-708d-4702-b07c-79c014cce218 tempest-ServersNegativeTestJSON-1436033101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:19 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:19:19 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-718a03d0-d351-4c82-ab52-4868bfa15ea2 tempest-ServersNegativeTestJSON-1436033101 None] Acquiring lock "cinder-5c39ea13-cc56-4c0b-af95-2163243fe6bc-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:19:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-718a03d0-d351-4c82-ab52-4868bfa15ea2 tempest-ServersNegativeTestJSON-1436033101 None] Lock "cinder-5c39ea13-cc56-4c0b-af95-2163243fe6bc-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:19:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-718a03d0-d351-4c82-ab52-4868bfa15ea2 tempest-ServersNegativeTestJSON-1436033101 None] Acquiring lock "cinder-quobyte-5c39ea13-cc56-4c0b-af95-2163243fe6bc" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:19:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-718a03d0-d351-4c82-ab52-4868bfa15ea2 tempest-ServersNegativeTestJSON-1436033101 None] Lock "cinder-quobyte-5c39ea13-cc56-4c0b-af95-2163243fe6bc" acquired by "delete_volume" :: waited 0.062s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:19:20 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ad586a-5fae-4d65-be56-40c7319e026c]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:19:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-718a03d0-d351-4c82-ab52-4868bfa15ea2 tempest-ServersNegativeTestJSON-1436033101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5c39ea13-cc56-4c0b-af95-2163243fe6bc {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:20 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5c39ea13-cc56-4c0b-af95-2163243fe6bc Jul 07 17:19:20 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:21 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f45c1d8e-708d-4702-b07c-79c014cce218 tempest-ServersNegativeTestJSON-1436033101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.485s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:21 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-f45c1d8e-708d-4702-b07c-79c014cce218 tempest-ServersNegativeTestJSON-1436033101 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:19:21 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-f45c1d8e-708d-4702-b07c-79c014cce218 tempest-ServersNegativeTestJSON-1436033101 None] Deleted volume successfully. Jul 07 17:19:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f45c1d8e-708d-4702-b07c-79c014cce218 tempest-ServersNegativeTestJSON-1436033101 None] Lock "cinder-21f918fa-86ef-4c7f-b7f1-35b871a3b59a-delete_volume" released by "delete_volume" :: held 4.655s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:19:22 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-718a03d0-d351-4c82-ab52-4868bfa15ea2 tempest-ServersNegativeTestJSON-1436033101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5c39ea13-cc56-4c0b-af95-2163243fe6bc" returned: 0 in 2.086s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-718a03d0-d351-4c82-ab52-4868bfa15ea2 tempest-ServersNegativeTestJSON-1436033101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5c39ea13-cc56-4c0b-af95-2163243fe6bc {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:22 devstack sudo[89673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5c39ea13-cc56-4c0b-af95-2163243fe6bc Jul 07 17:19:22 devstack sudo[89673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:23 devstack sudo[89673]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-718a03d0-d351-4c82-ab52-4868bfa15ea2 tempest-ServersNegativeTestJSON-1436033101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5c39ea13-cc56-4c0b-af95-2163243fe6bc" returned: 0 in 1.287s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:23 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-718a03d0-d351-4c82-ab52-4868bfa15ea2 tempest-ServersNegativeTestJSON-1436033101 None] Lock "cinder-quobyte-5c39ea13-cc56-4c0b-af95-2163243fe6bc" released by "delete_volume" :: held 3.472s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:19:23 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-718a03d0-d351-4c82-ab52-4868bfa15ea2 tempest-ServersNegativeTestJSON-1436033101 None] Created reservations ['0131cda0-0a04-4df6-9f98-b0327039d046', 'c50ba2bd-2c2f-45a2-8a5b-000baa905d6d', '003bdf53-4acc-418a-addc-48c0321ad31a', '1dfbb02c-e97b-4c60-b547-08d849942f2c'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:19:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-718a03d0-d351-4c82-ab52-4868bfa15ea2 tempest-ServersNegativeTestJSON-1436033101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:19:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-718a03d0-d351-4c82-ab52-4868bfa15ea2 tempest-ServersNegativeTestJSON-1436033101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:19:24 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-718a03d0-d351-4c82-ab52-4868bfa15ea2 tempest-ServersNegativeTestJSON-1436033101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:19:24 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-718a03d0-d351-4c82-ab52-4868bfa15ea2 tempest-ServersNegativeTestJSON-1436033101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:19:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-718a03d0-d351-4c82-ab52-4868bfa15ea2 tempest-ServersNegativeTestJSON-1436033101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:19:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-718a03d0-d351-4c82-ab52-4868bfa15ea2 tempest-ServersNegativeTestJSON-1436033101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:24 devstack sudo[89710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:19:24 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:25 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-718a03d0-d351-4c82-ab52-4868bfa15ea2 tempest-ServersNegativeTestJSON-1436033101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.296s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:25 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-718a03d0-d351-4c82-ab52-4868bfa15ea2 tempest-ServersNegativeTestJSON-1436033101 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:19:25 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-718a03d0-d351-4c82-ab52-4868bfa15ea2 tempest-ServersNegativeTestJSON-1436033101 None] Deleted volume successfully. Jul 07 17:19:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-718a03d0-d351-4c82-ab52-4868bfa15ea2 tempest-ServersNegativeTestJSON-1436033101 None] Lock "cinder-5c39ea13-cc56-4c0b-af95-2163243fe6bc-delete_volume" released by "delete_volume" :: held 5.362s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:19:34 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:UPDATE=28,cinder:SELECT=16,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:19:35 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=16,cinder:DELETE=3,cinder:UPDATE=22,cinder:INSERT=8 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:19:46 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:19:46 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Flow 'volume_create_manager' (5a6d0b9b-2131-43c6-9117-4a094d4df05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:19:46 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea8fb669-102d-41a0-83a7-cd4463289e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:46 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea8fb669-102d-41a0-83a7-cd4463289e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1586892968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57462a4-4598-4088-80a9-fc39e0aff319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b5099fe0ed4762a29315f499a1cc05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:19:46Z,use_quota=True,user_id='4769ce4ed6e3498f935bdfd1fde01b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:46 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163ec2d8-f358-4989-a020-1f65fc1396bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:46 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163ec2d8-f358-4989-a020-1f65fc1396bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:46 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3d072c-db12-4582-9678-a22e5aa73a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:46 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3d072c-db12-4582-9678-a22e5aa73a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f57462a4-4598-4088-80a9-fc39e0aff319', 'volume_name': 'volume-f57462a4-4598-4088-80a9-fc39e0aff319', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:46 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aec5322-a0dd-4b90-8c1e-095f03f9b2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:46 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aec5322-a0dd-4b90-8c1e-095f03f9b2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:46 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe7bd60-f9a0-4863-a3ce-e74d4b511e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:46 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Volume f57462a4-4598-4088-80a9-fc39e0aff319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f57462a4-4598-4088-80a9-fc39e0aff319', 'volume_size': 1} Jul 07 17:19:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:19:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:19:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1586892968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57462a4-4598-4088-80a9-fc39e0aff319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b5099fe0ed4762a29315f499a1cc05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:19:46Z,use_quota=True,user_id='4769ce4ed6e3498f935bdfd1fde01b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:19:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Creating volume f57462a4-4598-4088-80a9-fc39e0aff319 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:19:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:19:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:19:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:19:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:19:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:19:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:19:46 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:19:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f57462a4-4598-4088-80a9-fc39e0aff319 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:46 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f57462a4-4598-4088-80a9-fc39e0aff319 1073741824 Jul 07 17:19:46 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:47 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f57462a4-4598-4088-80a9-fc39e0aff319 1073741824" returned: 0 in 1.058s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f57462a4-4598-4088-80a9-fc39e0aff319 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:47 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f57462a4-4598-4088-80a9-fc39e0aff319 Jul 07 17:19:47 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:48 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f57462a4-4598-4088-80a9-fc39e0aff319" returned: 0 in 0.997s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] <== create_volume: return (2123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:19:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.129s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:19:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe7bd60-f9a0-4863-a3ce-e74d4b511e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f57462a4-4598-4088-80a9-fc39e0aff319', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f488a22e-5188-41c7-a8c8-a89cfbfd007f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:48 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Volume volume-f57462a4-4598-4088-80a9-fc39e0aff319 (f57462a4-4598-4088-80a9-fc39e0aff319): created successfully Jul 07 17:19:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f488a22e-5188-41c7-a8c8-a89cfbfd007f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Flow 'volume_create_manager' (5a6d0b9b-2131-43c6-9117-4a094d4df05d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:19:48 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-d1a828be-197d-4202-a071-c0dadd354914 tempest-AttachVolumeShelveTestJSON-1993120243 None] Created volume successfully. Jul 07 17:19:51 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-77708ed8-3312-4714-907e-32f71abd96c4 tempest-BackendsCapabilitiesAdminTestsJSON-488562270 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87303) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 17:19:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-65cf2760-f438-4d70-a004-94edf30f4929 tempest-BackendsCapabilitiesAdminTestsJSON-488562270 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87303) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 17:19:54 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:19:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Flow 'volume_create_manager' (344a8729-3d34-42a2-8203-8331a5aca8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:19:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18542ee8-6dc5-4d7a-9f47-353bab7b2520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18542ee8-6dc5-4d7a-9f47-353bab7b2520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1418633766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84d32bd-1ed2-442a-aeb9-1cd9023c283b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='446e81ef1cc84a43a46e6879cee1f7ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:19:54Z,use_quota=True,user_id='7ae422fed39940ddaaa0decdc98fe50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f101229-cee1-47c7-a5a2-0d275d07b566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f101229-cee1-47c7-a5a2-0d275d07b566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e6007c5-54cb-4914-a1f1-fd9bbdd53971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e6007c5-54cb-4914-a1f1-fd9bbdd53971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a84d32bd-1ed2-442a-aeb9-1cd9023c283b', 'volume_name': 'volume-a84d32bd-1ed2-442a-aeb9-1cd9023c283b', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a15514-a2bf-40db-a304-21b6ab44e220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a15514-a2bf-40db-a304-21b6ab44e220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d084ae6-9178-4485-a147-a09d353fa5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:54 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Volume a84d32bd-1ed2-442a-aeb9-1cd9023c283b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a84d32bd-1ed2-442a-aeb9-1cd9023c283b', 'volume_size': 1} Jul 07 17:19:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:19:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:19:54 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1418633766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84d32bd-1ed2-442a-aeb9-1cd9023c283b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='446e81ef1cc84a43a46e6879cee1f7ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:19:54Z,use_quota=True,user_id='7ae422fed39940ddaaa0decdc98fe50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:19:54 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Creating volume a84d32bd-1ed2-442a-aeb9-1cd9023c283b {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:19:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:19:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:19:54 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:19:54 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:19:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:19:54 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:19:54 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:19:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a84d32bd-1ed2-442a-aeb9-1cd9023c283b 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:54 devstack sudo[90010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a84d32bd-1ed2-442a-aeb9-1cd9023c283b 1073741824 Jul 07 17:19:54 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:55 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a84d32bd-1ed2-442a-aeb9-1cd9023c283b 1073741824" returned: 0 in 1.161s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a84d32bd-1ed2-442a-aeb9-1cd9023c283b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:55 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a84d32bd-1ed2-442a-aeb9-1cd9023c283b Jul 07 17:19:55 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:56 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a84d32bd-1ed2-442a-aeb9-1cd9023c283b" returned: 0 in 0.813s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] <== create_volume: return (2034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:19:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.037s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:19:56 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d084ae6-9178-4485-a147-a09d353fa5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a84d32bd-1ed2-442a-aeb9-1cd9023c283b', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:56 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bf3c7d-b1a1-4db3-8322-678f318d6e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:19:56 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Volume volume-a84d32bd-1ed2-442a-aeb9-1cd9023c283b (a84d32bd-1ed2-442a-aeb9-1cd9023c283b): created successfully Jul 07 17:19:56 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bf3c7d-b1a1-4db3-8322-678f318d6e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:19:56 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Flow 'volume_create_manager' (344a8729-3d34-42a2-8203-8331a5aca8c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:19:56 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-1f7ee39d-57ff-41e0-94eb-e5bdd5416695 tempest-AttachVolumeTestJSON-285176547 None] Created volume successfully. Jul 07 17:19:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:19:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:19:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:19:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:19:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:19:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:19:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:19:56 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:19:56 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:19:57 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Jul 07 17:19:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.719s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:19:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:19:57 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:19:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 8 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:19:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:20:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-7488e051-796b-49c5-b027-f51b0d168042 req-9519019a-47c8-49f0-b7a8-17c9476b2736 tempest-AttachVolumeTestJSON-285176547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-7488e051-796b-49c5-b027-f51b0d168042 req-9519019a-47c8-49f0-b7a8-17c9476b2736 tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:00 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9b564e-8746-4c3c-b62d-59986a6344f2]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:20:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-7488e051-796b-49c5-b027-f51b0d168042 req-9519019a-47c8-49f0-b7a8-17c9476b2736 tempest-AttachVolumeTestJSON-285176547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a84d32bd-1ed2-442a-aeb9-1cd9023c283b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:00 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a84d32bd-1ed2-442a-aeb9-1cd9023c283b Jul 07 17:20:00 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:01 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-7488e051-796b-49c5-b027-f51b0d168042 req-9519019a-47c8-49f0-b7a8-17c9476b2736 tempest-AttachVolumeTestJSON-285176547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a84d32bd-1ed2-442a-aeb9-1cd9023c283b" returned: 0 in 0.938s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-7488e051-796b-49c5-b027-f51b0d168042 req-9519019a-47c8-49f0-b7a8-17c9476b2736 tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.970s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-7488e051-796b-49c5-b027-f51b0d168042 req-9519019a-47c8-49f0-b7a8-17c9476b2736 tempest-AttachVolumeTestJSON-285176547 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2', 'name': 'volume-a84d32bd-1ed2-442a-aeb9-1cd9023c283b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf2b2c77-944e-49a3-9dc6-32ece9314059', 'enforce_multipath': True} {{(pid=87303) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:20:01 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-7488e051-796b-49c5-b027-f51b0d168042 req-9519019a-47c8-49f0-b7a8-17c9476b2736 tempest-AttachVolumeTestJSON-285176547 None] attachment_update completed successfully. Jul 07 17:20:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-580ceaa7-056a-4250-88df-31774fae8c09 req-7df2eb91-3f31-4868-9e47-84e87fbcccc5 tempest-AttachVolumeShelveTestJSON-1993120243 None] No connector for attachment 69c3b0bf-f965-4809-858e-b08f1923b9a8; skipping storage backend terminate_connection call. {{(pid=87303) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 07 17:20:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-580ceaa7-056a-4250-88df-31774fae8c09 req-7df2eb91-3f31-4868-9e47-84e87fbcccc5 tempest-AttachVolumeShelveTestJSON-1993120243 None] Deleting attachment 69c3b0bf-f965-4809-858e-b08f1923b9a8. {{(pid=87303) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:20:11 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:UPDATE=13,cinder:SELECT=8,cinder:DELETE=1 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:20:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-d0761bc9-6da9-46b8-8aa1-a48499de2739 req-6ca059a2-d075-47ce-84ab-0c2bbf34aff1 tempest-TaggedAttachmentsTest-980876671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-d0761bc9-6da9-46b8-8aa1-a48499de2739 req-6ca059a2-d075-47ce-84ab-0c2bbf34aff1 tempest-TaggedAttachmentsTest-980876671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:14 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b0702f-b473-415b-b9f0-4819e6436df4]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:20:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-d0761bc9-6da9-46b8-8aa1-a48499de2739 req-6ca059a2-d075-47ce-84ab-0c2bbf34aff1 tempest-TaggedAttachmentsTest-980876671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-370d5bba-99c8-4e0b-86a3-25a4bf69fc91 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:14 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-370d5bba-99c8-4e0b-86a3-25a4bf69fc91 Jul 07 17:20:14 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:15 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-d0761bc9-6da9-46b8-8aa1-a48499de2739 req-6ca059a2-d075-47ce-84ab-0c2bbf34aff1 tempest-TaggedAttachmentsTest-980876671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-370d5bba-99c8-4e0b-86a3-25a4bf69fc91" returned: 0 in 0.995s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-d0761bc9-6da9-46b8-8aa1-a48499de2739 req-6ca059a2-d075-47ce-84ab-0c2bbf34aff1 tempest-TaggedAttachmentsTest-980876671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.023s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-d0761bc9-6da9-46b8-8aa1-a48499de2739 req-6ca059a2-d075-47ce-84ab-0c2bbf34aff1 tempest-TaggedAttachmentsTest-980876671 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2', 'name': 'volume-370d5bba-99c8-4e0b-86a3-25a4bf69fc91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44cfc161-8605-446d-9a38-fd376cae5c0e', 'enforce_multipath': True} {{(pid=87303) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:20:15 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-d0761bc9-6da9-46b8-8aa1-a48499de2739 req-6ca059a2-d075-47ce-84ab-0c2bbf34aff1 tempest-TaggedAttachmentsTest-980876671 None] attachment_update completed successfully. Jul 07 17:20:22 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:20:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Flow 'volume_create_manager' (e92df6ff-8bc3-4f5b-91fc-e350200a113e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:20:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ac3a47-b0c9-4012-94dc-784ceba222e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ac3a47-b0c9-4012-94dc-784ceba222e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1110724527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3635aa-40e8-477a-84d6-83fbdd5b17a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d5ac529a7740a2b65af202654565e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:20:22Z,use_quota=True,user_id='208e9d859ef0414ab98671ebd2f35d98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2daf1e-e31c-49b0-8f1b-6bbd0229c88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2daf1e-e31c-49b0-8f1b-6bbd0229c88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731dafef-0aab-46a6-956a-d1e3d1ae66d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731dafef-0aab-46a6-956a-d1e3d1ae66d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec3635aa-40e8-477a-84d6-83fbdd5b17a9', 'volume_name': 'volume-ec3635aa-40e8-477a-84d6-83fbdd5b17a9', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fb5868-4f1b-4018-832a-fcdc7bc00be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fb5868-4f1b-4018-832a-fcdc7bc00be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d55bc23-8e20-40b3-bb95-da6c461cb654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:22 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Volume ec3635aa-40e8-477a-84d6-83fbdd5b17a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec3635aa-40e8-477a-84d6-83fbdd5b17a9', 'volume_size': 1} Jul 07 17:20:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1110724527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3635aa-40e8-477a-84d6-83fbdd5b17a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d5ac529a7740a2b65af202654565e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:20:22Z,use_quota=True,user_id='208e9d859ef0414ab98671ebd2f35d98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:20:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Creating volume ec3635aa-40e8-477a-84d6-83fbdd5b17a9 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:20:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:20:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:20:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:20:22 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:20:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ec3635aa-40e8-477a-84d6-83fbdd5b17a9 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:22 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ec3635aa-40e8-477a-84d6-83fbdd5b17a9 1073741824 Jul 07 17:20:22 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:22 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-afd7cb2f-3b2a-4a8e-b223-3c8a40e6b22f req-d2ed2a3d-f477-41a8-be4f-de35a593f922 tempest-TaggedAttachmentsTest-980876671 None] Terminate volume connection completed successfully. Jul 07 17:20:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-afd7cb2f-3b2a-4a8e-b223-3c8a40e6b22f req-d2ed2a3d-f477-41a8-be4f-de35a593f922 tempest-TaggedAttachmentsTest-980876671 None] Deleting attachment 44cfc161-8605-446d-9a38-fd376cae5c0e. {{(pid=87303) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:20:23 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ec3635aa-40e8-477a-84d6-83fbdd5b17a9 1073741824" returned: 0 in 1.287s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ec3635aa-40e8-477a-84d6-83fbdd5b17a9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:23 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ec3635aa-40e8-477a-84d6-83fbdd5b17a9 Jul 07 17:20:23 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:24 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ec3635aa-40e8-477a-84d6-83fbdd5b17a9" returned: 0 in 0.917s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:24 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] <== create_volume: return (2300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:20:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.307s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d55bc23-8e20-40b3-bb95-da6c461cb654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec3635aa-40e8-477a-84d6-83fbdd5b17a9', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed693b9c-278e-4d63-b83a-d5fe657cf24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:24 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Volume volume-ec3635aa-40e8-477a-84d6-83fbdd5b17a9 (ec3635aa-40e8-477a-84d6-83fbdd5b17a9): created successfully Jul 07 17:20:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed693b9c-278e-4d63-b83a-d5fe657cf24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Flow 'volume_create_manager' (e92df6ff-8bc3-4f5b-91fc-e350200a113e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:20:24 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-e0fcb989-119d-4a7d-806a-d819632dd38e tempest-VolumeQuotasAdminTestJSON-1244253444 None] Created volume successfully. Jul 07 17:20:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b60dca89-1f3b-45c0-9f97-c64f95deec75 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Acquiring lock "cinder-ec3635aa-40e8-477a-84d6-83fbdd5b17a9-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:20:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b60dca89-1f3b-45c0-9f97-c64f95deec75 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Lock "cinder-ec3635aa-40e8-477a-84d6-83fbdd5b17a9-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:20:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b60dca89-1f3b-45c0-9f97-c64f95deec75 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Acquiring lock "cinder-quobyte-ec3635aa-40e8-477a-84d6-83fbdd5b17a9" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:20:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b60dca89-1f3b-45c0-9f97-c64f95deec75 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Lock "cinder-quobyte-ec3635aa-40e8-477a-84d6-83fbdd5b17a9" acquired by "delete_volume" :: waited 0.039s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:20:25 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[14387e8e-0c2f-4968-b246-09c29bffc95f]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:20:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b60dca89-1f3b-45c0-9f97-c64f95deec75 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ec3635aa-40e8-477a-84d6-83fbdd5b17a9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:25 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ec3635aa-40e8-477a-84d6-83fbdd5b17a9 Jul 07 17:20:25 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:27 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b60dca89-1f3b-45c0-9f97-c64f95deec75 tempest-VolumeQuotasAdminTestJSON-1244253444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ec3635aa-40e8-477a-84d6-83fbdd5b17a9" returned: 0 in 1.586s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b60dca89-1f3b-45c0-9f97-c64f95deec75 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ec3635aa-40e8-477a-84d6-83fbdd5b17a9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:27 devstack sudo[90779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ec3635aa-40e8-477a-84d6-83fbdd5b17a9 Jul 07 17:20:27 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:27 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b60dca89-1f3b-45c0-9f97-c64f95deec75 tempest-VolumeQuotasAdminTestJSON-1244253444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ec3635aa-40e8-477a-84d6-83fbdd5b17a9" returned: 0 in 0.722s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b60dca89-1f3b-45c0-9f97-c64f95deec75 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Lock "cinder-quobyte-ec3635aa-40e8-477a-84d6-83fbdd5b17a9" released by "delete_volume" :: held 2.383s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:20:28 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-b60dca89-1f3b-45c0-9f97-c64f95deec75 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Created reservations ['340b17b3-bf39-42a3-a1d4-d51b9c0acf17', '18070160-8e13-4fd4-8ec3-352ef7214ad7', 'dc702f98-87fc-4f17-a228-40a7a9af0b82', 'f6ef7d0b-d779-47f4-928e-964017c6daaa'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:20:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b60dca89-1f3b-45c0-9f97-c64f95deec75 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b60dca89-1f3b-45c0-9f97-c64f95deec75 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b60dca89-1f3b-45c0-9f97-c64f95deec75 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:20:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b60dca89-1f3b-45c0-9f97-c64f95deec75 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:20:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b60dca89-1f3b-45c0-9f97-c64f95deec75 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b60dca89-1f3b-45c0-9f97-c64f95deec75 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:28 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:20:28 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:29 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b60dca89-1f3b-45c0-9f97-c64f95deec75 tempest-VolumeQuotasAdminTestJSON-1244253444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.272s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:29 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-b60dca89-1f3b-45c0-9f97-c64f95deec75 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:20:29 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b60dca89-1f3b-45c0-9f97-c64f95deec75 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Deleted volume successfully. Jul 07 17:20:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b60dca89-1f3b-45c0-9f97-c64f95deec75 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Lock "cinder-ec3635aa-40e8-477a-84d6-83fbdd5b17a9-delete_volume" released by "delete_volume" :: held 4.021s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:20:30 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:20:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Flow 'volume_create_manager' (5ff5ac4a-3e1a-4935-b224-b151323a88eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:20:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca324682-7b6e-4928-81a4-5d5c28b8c711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca324682-7b6e-4928-81a4-5d5c28b8c711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1348527914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee625b8-8ded-48cb-9943-65bef28bad2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d5ac529a7740a2b65af202654565e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:20:30Z,use_quota=True,user_id='208e9d859ef0414ab98671ebd2f35d98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54649a3d-a23c-4905-9ada-4c831814b334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54649a3d-a23c-4905-9ada-4c831814b334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f501e39-d56a-46f1-9483-7626316701a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f501e39-d56a-46f1-9483-7626316701a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ee625b8-8ded-48cb-9943-65bef28bad2f', 'volume_name': 'volume-1ee625b8-8ded-48cb-9943-65bef28bad2f', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040513ec-89ed-4ee1-9f7a-8da3dbf8254b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040513ec-89ed-4ee1-9f7a-8da3dbf8254b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73797a4d-a37b-4092-935b-67d9a4cb6a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:30 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Volume 1ee625b8-8ded-48cb-9943-65bef28bad2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ee625b8-8ded-48cb-9943-65bef28bad2f', 'volume_size': 1} Jul 07 17:20:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1348527914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee625b8-8ded-48cb-9943-65bef28bad2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d5ac529a7740a2b65af202654565e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:20:30Z,use_quota=True,user_id='208e9d859ef0414ab98671ebd2f35d98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:20:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Creating volume 1ee625b8-8ded-48cb-9943-65bef28bad2f {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:20:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:20:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:20:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:20:30 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:20:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1ee625b8-8ded-48cb-9943-65bef28bad2f 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:30 devstack sudo[90845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1ee625b8-8ded-48cb-9943-65bef28bad2f 1073741824 Jul 07 17:20:30 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:31 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1ee625b8-8ded-48cb-9943-65bef28bad2f 1073741824" returned: 0 in 1.025s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1ee625b8-8ded-48cb-9943-65bef28bad2f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:31 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1ee625b8-8ded-48cb-9943-65bef28bad2f Jul 07 17:20:31 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:32 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1ee625b8-8ded-48cb-9943-65bef28bad2f" returned: 0 in 1.102s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] <== create_volume: return (2178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:20:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.181s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73797a4d-a37b-4092-935b-67d9a4cb6a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ee625b8-8ded-48cb-9943-65bef28bad2f', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0996c8-7067-44fe-8632-f358861c9dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:32 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Volume volume-1ee625b8-8ded-48cb-9943-65bef28bad2f (1ee625b8-8ded-48cb-9943-65bef28bad2f): created successfully Jul 07 17:20:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0996c8-7067-44fe-8632-f358861c9dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Flow 'volume_create_manager' (5ff5ac4a-3e1a-4935-b224-b151323a88eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:20:32 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-7e410060-a2f1-4a3e-be5f-87ae72485b50 tempest-VolumeQuotasAdminTestJSON-1244253444 None] Created volume successfully. Jul 07 17:20:34 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-00d2c489-3cae-4b28-bca4-d27c38627aa5 tempest-VolumeQuotasAdminTestJSON-1132178946 None] Transfer volume completed successfully. Jul 07 17:20:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b98d77fb-427d-47fb-8b8f-cc1df9321cf7 tempest-VolumeQuotasAdminTestJSON-683311799 None] Acquiring lock "cinder-1ee625b8-8ded-48cb-9943-65bef28bad2f-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:20:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b98d77fb-427d-47fb-8b8f-cc1df9321cf7 tempest-VolumeQuotasAdminTestJSON-683311799 None] Lock "cinder-1ee625b8-8ded-48cb-9943-65bef28bad2f-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:20:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b98d77fb-427d-47fb-8b8f-cc1df9321cf7 tempest-VolumeQuotasAdminTestJSON-683311799 None] Acquiring lock "cinder-quobyte-1ee625b8-8ded-48cb-9943-65bef28bad2f" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:20:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b98d77fb-427d-47fb-8b8f-cc1df9321cf7 tempest-VolumeQuotasAdminTestJSON-683311799 None] Lock "cinder-quobyte-1ee625b8-8ded-48cb-9943-65bef28bad2f" acquired by "delete_volume" :: waited 0.041s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:20:36 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[893d8f52-1f8f-410e-bb06-aaecc10138df]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:20:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b98d77fb-427d-47fb-8b8f-cc1df9321cf7 tempest-VolumeQuotasAdminTestJSON-683311799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1ee625b8-8ded-48cb-9943-65bef28bad2f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:36 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1ee625b8-8ded-48cb-9943-65bef28bad2f Jul 07 17:20:36 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:37 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b98d77fb-427d-47fb-8b8f-cc1df9321cf7 tempest-VolumeQuotasAdminTestJSON-683311799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1ee625b8-8ded-48cb-9943-65bef28bad2f" returned: 0 in 1.153s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b98d77fb-427d-47fb-8b8f-cc1df9321cf7 tempest-VolumeQuotasAdminTestJSON-683311799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1ee625b8-8ded-48cb-9943-65bef28bad2f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:37 devstack sudo[90945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1ee625b8-8ded-48cb-9943-65bef28bad2f Jul 07 17:20:37 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:38 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b98d77fb-427d-47fb-8b8f-cc1df9321cf7 tempest-VolumeQuotasAdminTestJSON-683311799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1ee625b8-8ded-48cb-9943-65bef28bad2f" returned: 0 in 0.659s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:38 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b98d77fb-427d-47fb-8b8f-cc1df9321cf7 tempest-VolumeQuotasAdminTestJSON-683311799 None] Lock "cinder-quobyte-1ee625b8-8ded-48cb-9943-65bef28bad2f" released by "delete_volume" :: held 1.884s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:20:38 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-b98d77fb-427d-47fb-8b8f-cc1df9321cf7 tempest-VolumeQuotasAdminTestJSON-683311799 None] Created reservations ['a9162ca1-e38e-4d04-9400-4ff409beed2b', 'b8eb9de8-2847-4e26-9d6b-2c361873e431', 'bf5f5be4-bb2f-43b1-b1cb-0d8c14cd7526', '6267a322-7fee-4b77-b54b-a8f163917070'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:20:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b98d77fb-427d-47fb-8b8f-cc1df9321cf7 tempest-VolumeQuotasAdminTestJSON-683311799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b98d77fb-427d-47fb-8b8f-cc1df9321cf7 tempest-VolumeQuotasAdminTestJSON-683311799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b98d77fb-427d-47fb-8b8f-cc1df9321cf7 tempest-VolumeQuotasAdminTestJSON-683311799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:20:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b98d77fb-427d-47fb-8b8f-cc1df9321cf7 tempest-VolumeQuotasAdminTestJSON-683311799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:20:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b98d77fb-427d-47fb-8b8f-cc1df9321cf7 tempest-VolumeQuotasAdminTestJSON-683311799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b98d77fb-427d-47fb-8b8f-cc1df9321cf7 tempest-VolumeQuotasAdminTestJSON-683311799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:38 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:20:38 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:39 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b98d77fb-427d-47fb-8b8f-cc1df9321cf7 tempest-VolumeQuotasAdminTestJSON-683311799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.809s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:39 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-b98d77fb-427d-47fb-8b8f-cc1df9321cf7 tempest-VolumeQuotasAdminTestJSON-683311799 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:20:39 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b98d77fb-427d-47fb-8b8f-cc1df9321cf7 tempest-VolumeQuotasAdminTestJSON-683311799 None] Deleted volume successfully. Jul 07 17:20:39 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b98d77fb-427d-47fb-8b8f-cc1df9321cf7 tempest-VolumeQuotasAdminTestJSON-683311799 None] Lock "cinder-1ee625b8-8ded-48cb-9943-65bef28bad2f-delete_volume" released by "delete_volume" :: held 2.996s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:20:44 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f9351a6b-59c5-4a0d-a1d3-cff18b28c6ff tempest-TaggedAttachmentsTest-980876671 None] Acquiring lock "cinder-370d5bba-99c8-4e0b-86a3-25a4bf69fc91-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:20:44 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f9351a6b-59c5-4a0d-a1d3-cff18b28c6ff tempest-TaggedAttachmentsTest-980876671 None] Lock "cinder-370d5bba-99c8-4e0b-86a3-25a4bf69fc91-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:20:44 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=35,cinder:INSERT=7,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:20:44 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f9351a6b-59c5-4a0d-a1d3-cff18b28c6ff tempest-TaggedAttachmentsTest-980876671 None] Acquiring lock "cinder-quobyte-370d5bba-99c8-4e0b-86a3-25a4bf69fc91" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:20:44 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f9351a6b-59c5-4a0d-a1d3-cff18b28c6ff tempest-TaggedAttachmentsTest-980876671 None] Lock "cinder-quobyte-370d5bba-99c8-4e0b-86a3-25a4bf69fc91" acquired by "delete_volume" :: waited 0.029s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:20:44 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe2f97f-a46f-4c5a-96f8-17f19e4d1066]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:20:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f9351a6b-59c5-4a0d-a1d3-cff18b28c6ff tempest-TaggedAttachmentsTest-980876671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-370d5bba-99c8-4e0b-86a3-25a4bf69fc91 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:44 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-370d5bba-99c8-4e0b-86a3-25a4bf69fc91 Jul 07 17:20:44 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:45 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f9351a6b-59c5-4a0d-a1d3-cff18b28c6ff tempest-TaggedAttachmentsTest-980876671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-370d5bba-99c8-4e0b-86a3-25a4bf69fc91" returned: 0 in 1.031s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f9351a6b-59c5-4a0d-a1d3-cff18b28c6ff tempest-TaggedAttachmentsTest-980876671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-370d5bba-99c8-4e0b-86a3-25a4bf69fc91 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:45 devstack sudo[90966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-370d5bba-99c8-4e0b-86a3-25a4bf69fc91 Jul 07 17:20:45 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:46 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f9351a6b-59c5-4a0d-a1d3-cff18b28c6ff tempest-TaggedAttachmentsTest-980876671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-370d5bba-99c8-4e0b-86a3-25a4bf69fc91" returned: 0 in 0.722s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:46 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f9351a6b-59c5-4a0d-a1d3-cff18b28c6ff tempest-TaggedAttachmentsTest-980876671 None] Lock "cinder-quobyte-370d5bba-99c8-4e0b-86a3-25a4bf69fc91" released by "delete_volume" :: held 1.814s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:20:46 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-f9351a6b-59c5-4a0d-a1d3-cff18b28c6ff tempest-TaggedAttachmentsTest-980876671 None] Created reservations ['abe8d79f-e5e9-44eb-863f-0b190006a4a2', '40ebe461-0955-4642-a941-fc5f7a719280', '5e19db52-09eb-4f75-a542-05e47b8c4010', '46eae6be-56d7-413f-93de-3a008d3dc0ae'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:20:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f9351a6b-59c5-4a0d-a1d3-cff18b28c6ff tempest-TaggedAttachmentsTest-980876671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f9351a6b-59c5-4a0d-a1d3-cff18b28c6ff tempest-TaggedAttachmentsTest-980876671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f9351a6b-59c5-4a0d-a1d3-cff18b28c6ff tempest-TaggedAttachmentsTest-980876671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:20:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f9351a6b-59c5-4a0d-a1d3-cff18b28c6ff tempest-TaggedAttachmentsTest-980876671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:20:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f9351a6b-59c5-4a0d-a1d3-cff18b28c6ff tempest-TaggedAttachmentsTest-980876671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f9351a6b-59c5-4a0d-a1d3-cff18b28c6ff tempest-TaggedAttachmentsTest-980876671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:46 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:20:46 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:47 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f9351a6b-59c5-4a0d-a1d3-cff18b28c6ff tempest-TaggedAttachmentsTest-980876671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.782s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-f9351a6b-59c5-4a0d-a1d3-cff18b28c6ff tempest-TaggedAttachmentsTest-980876671 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:20:47 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-f9351a6b-59c5-4a0d-a1d3-cff18b28c6ff tempest-TaggedAttachmentsTest-980876671 None] Deleted volume successfully. Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f9351a6b-59c5-4a0d-a1d3-cff18b28c6ff tempest-TaggedAttachmentsTest-980876671 None] Lock "cinder-370d5bba-99c8-4e0b-86a3-25a4bf69fc91-delete_volume" released by "delete_volume" :: held 2.853s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:20:47 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-daeaa9aa-fcdb-4864-9bf4-6bcfa50138af req-baf017ec-0ead-43fd-aaad-5f3177c0959d tempest-AttachVolumeTestJSON-285176547 None] Terminate volume connection completed successfully. Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-daeaa9aa-fcdb-4864-9bf4-6bcfa50138af req-baf017ec-0ead-43fd-aaad-5f3177c0959d tempest-AttachVolumeTestJSON-285176547 None] Deleting attachment bf2b2c77-944e-49a3-9dc6-32ece9314059. {{(pid=87303) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Flow 'volume_create_manager' (171e28af-ff60-413c-8fdd-200b38a3c357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7f5bbf-f0ea-459c-b032-19aa00088083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7f5bbf-f0ea-459c-b032-19aa00088083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2141363423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d17a4a9-ab89-4347-9338-5d881122dac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6803aacbf8a448ca9a70884e88c3f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:20:48Z,use_quota=True,user_id='5135edf4cc1d4494bd8ed50c6a60962b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2f1d83-76d5-4df3-bd04-45cd547dad6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2f1d83-76d5-4df3-bd04-45cd547dad6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab9d133-6aed-429c-90fe-6d367895716e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab9d133-6aed-429c-90fe-6d367895716e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d17a4a9-ab89-4347-9338-5d881122dac8', 'volume_name': 'volume-5d17a4a9-ab89-4347-9338-5d881122dac8', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (520f1366-2de5-4a42-8517-92fb1129be65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (520f1366-2de5-4a42-8517-92fb1129be65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db98b3c0-ce75-43b5-92d5-5b986eeccdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:47 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Volume 5d17a4a9-ab89-4347-9338-5d881122dac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d17a4a9-ab89-4347-9338-5d881122dac8', 'volume_size': 1} Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2141363423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d17a4a9-ab89-4347-9338-5d881122dac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6803aacbf8a448ca9a70884e88c3f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:20:48Z,use_quota=True,user_id='5135edf4cc1d4494bd8ed50c6a60962b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Creating volume 5d17a4a9-ab89-4347-9338-5d881122dac8 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:20:47 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:20:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5d17a4a9-ab89-4347-9338-5d881122dac8 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:48 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5d17a4a9-ab89-4347-9338-5d881122dac8 1073741824 Jul 07 17:20:48 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:48 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5d17a4a9-ab89-4347-9338-5d881122dac8 1073741824" returned: 0 in 1.014s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5d17a4a9-ab89-4347-9338-5d881122dac8 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:49 devstack sudo[90982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5d17a4a9-ab89-4347-9338-5d881122dac8 Jul 07 17:20:49 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:49 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5d17a4a9-ab89-4347-9338-5d881122dac8" returned: 0 in 0.803s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:20:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db98b3c0-ce75-43b5-92d5-5b986eeccdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d17a4a9-ab89-4347-9338-5d881122dac8', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b855d224-c003-47b6-b3b9-b51f5448c8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:20:49 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Volume volume-5d17a4a9-ab89-4347-9338-5d881122dac8 (5d17a4a9-ab89-4347-9338-5d881122dac8): created successfully Jul 07 17:20:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b855d224-c003-47b6-b3b9-b51f5448c8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:20:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Flow 'volume_create_manager' (171e28af-ff60-413c-8fdd-200b38a3c357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:20:49 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-dc34f94e-b1a2-49b8-ae31-ba39d7e40592 tempest-VolumesServicesTestJSON-2055056002 None] Created volume successfully. Jul 07 17:20:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7f7cfdb0-f54b-4f96-9b0a-16bfcfce0ea8 tempest-VolumesServicesTestJSON-2055056002 None] Acquiring lock "cinder-5d17a4a9-ab89-4347-9338-5d881122dac8-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:20:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7f7cfdb0-f54b-4f96-9b0a-16bfcfce0ea8 tempest-VolumesServicesTestJSON-2055056002 None] Lock "cinder-5d17a4a9-ab89-4347-9338-5d881122dac8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:20:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7f7cfdb0-f54b-4f96-9b0a-16bfcfce0ea8 tempest-VolumesServicesTestJSON-2055056002 None] Acquiring lock "cinder-quobyte-5d17a4a9-ab89-4347-9338-5d881122dac8" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:20:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7f7cfdb0-f54b-4f96-9b0a-16bfcfce0ea8 tempest-VolumesServicesTestJSON-2055056002 None] Lock "cinder-quobyte-5d17a4a9-ab89-4347-9338-5d881122dac8" acquired by "delete_volume" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:20:51 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5dba3b-9397-431b-9c8b-9750ef11325b]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:20:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7f7cfdb0-f54b-4f96-9b0a-16bfcfce0ea8 tempest-VolumesServicesTestJSON-2055056002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5d17a4a9-ab89-4347-9338-5d881122dac8 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:51 devstack sudo[90991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5d17a4a9-ab89-4347-9338-5d881122dac8 Jul 07 17:20:51 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:52 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7f7cfdb0-f54b-4f96-9b0a-16bfcfce0ea8 tempest-VolumesServicesTestJSON-2055056002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5d17a4a9-ab89-4347-9338-5d881122dac8" returned: 0 in 1.094s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7f7cfdb0-f54b-4f96-9b0a-16bfcfce0ea8 tempest-VolumesServicesTestJSON-2055056002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5d17a4a9-ab89-4347-9338-5d881122dac8 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:52 devstack sudo[90999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5d17a4a9-ab89-4347-9338-5d881122dac8 Jul 07 17:20:52 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:53 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7f7cfdb0-f54b-4f96-9b0a-16bfcfce0ea8 tempest-VolumesServicesTestJSON-2055056002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5d17a4a9-ab89-4347-9338-5d881122dac8" returned: 0 in 0.840s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7f7cfdb0-f54b-4f96-9b0a-16bfcfce0ea8 tempest-VolumesServicesTestJSON-2055056002 None] Lock "cinder-quobyte-5d17a4a9-ab89-4347-9338-5d881122dac8" released by "delete_volume" :: held 2.006s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:20:53 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-7f7cfdb0-f54b-4f96-9b0a-16bfcfce0ea8 tempest-VolumesServicesTestJSON-2055056002 None] Created reservations ['96fd4c53-277a-4a3f-87a6-39d0583c27d3', 'e5597343-e24d-41ba-be70-ee780d2a72f4', '71523be0-df29-4f87-b799-fadc521091e0', 'dfa9fb81-82c4-453a-9883-ef70a9932190'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:20:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7f7cfdb0-f54b-4f96-9b0a-16bfcfce0ea8 tempest-VolumesServicesTestJSON-2055056002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7f7cfdb0-f54b-4f96-9b0a-16bfcfce0ea8 tempest-VolumesServicesTestJSON-2055056002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:53 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7f7cfdb0-f54b-4f96-9b0a-16bfcfce0ea8 tempest-VolumesServicesTestJSON-2055056002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:20:53 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7f7cfdb0-f54b-4f96-9b0a-16bfcfce0ea8 tempest-VolumesServicesTestJSON-2055056002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:20:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7f7cfdb0-f54b-4f96-9b0a-16bfcfce0ea8 tempest-VolumesServicesTestJSON-2055056002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7f7cfdb0-f54b-4f96-9b0a-16bfcfce0ea8 tempest-VolumesServicesTestJSON-2055056002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:53 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:20:53 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:54 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7f7cfdb0-f54b-4f96-9b0a-16bfcfce0ea8 tempest-VolumesServicesTestJSON-2055056002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.830s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:54 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-7f7cfdb0-f54b-4f96-9b0a-16bfcfce0ea8 tempest-VolumesServicesTestJSON-2055056002 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:20:54 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-7f7cfdb0-f54b-4f96-9b0a-16bfcfce0ea8 tempest-VolumesServicesTestJSON-2055056002 None] Deleted volume successfully. Jul 07 17:20:54 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7f7cfdb0-f54b-4f96-9b0a-16bfcfce0ea8 tempest-VolumesServicesTestJSON-2055056002 None] Lock "cinder-5d17a4a9-ab89-4347-9338-5d881122dac8-delete_volume" released by "delete_volume" :: held 3.101s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:20:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:20:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:20:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:20:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:20:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:20:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:20:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:20:56 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:20:56 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:20:57 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Jul 07 17:20:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.251s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:20:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:20:57 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:20:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 8 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:20:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:21:03 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=36,cinder:UPDATE=40,cinder:INSERT=10,cinder:DELETE=5 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:21:04 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=11,cinder:INSERT=4,cinder:UPDATE=21,cinder:DELETE=1 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:21:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c4980497-56fc-4515-8d4b-8e013e045dca tempest-AttachVolumeShelveTestJSON-1993120243 None] Acquiring lock "cinder-f57462a4-4598-4088-80a9-fc39e0aff319-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c4980497-56fc-4515-8d4b-8e013e045dca tempest-AttachVolumeShelveTestJSON-1993120243 None] Lock "cinder-f57462a4-4598-4088-80a9-fc39e0aff319-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c4980497-56fc-4515-8d4b-8e013e045dca tempest-AttachVolumeShelveTestJSON-1993120243 None] Acquiring lock "cinder-quobyte-f57462a4-4598-4088-80a9-fc39e0aff319" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c4980497-56fc-4515-8d4b-8e013e045dca tempest-AttachVolumeShelveTestJSON-1993120243 None] Lock "cinder-quobyte-f57462a4-4598-4088-80a9-fc39e0aff319" acquired by "delete_volume" :: waited 0.017s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:08 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e9d87b-eddc-47c8-a451-7d25aabf9b8f]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c4980497-56fc-4515-8d4b-8e013e045dca tempest-AttachVolumeShelveTestJSON-1993120243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f57462a4-4598-4088-80a9-fc39e0aff319 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:09 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f57462a4-4598-4088-80a9-fc39e0aff319 Jul 07 17:21:09 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:10 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c4980497-56fc-4515-8d4b-8e013e045dca tempest-AttachVolumeShelveTestJSON-1993120243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f57462a4-4598-4088-80a9-fc39e0aff319" returned: 0 in 1.449s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c4980497-56fc-4515-8d4b-8e013e045dca tempest-AttachVolumeShelveTestJSON-1993120243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f57462a4-4598-4088-80a9-fc39e0aff319 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:10 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f57462a4-4598-4088-80a9-fc39e0aff319 Jul 07 17:21:10 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:10 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:21:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Flow 'volume_create_manager' (301b5349-1b9c-4fbc-8897-c7f64b84e4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:21:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d7b6a4-aee9-4bcb-a274-1a30cebce05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d7b6a4-aee9-4bcb-a274-1a30cebce05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-772804361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d382c52-ae35-48de-8c74-47474411bcc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b37b17f91d4467b8159feb462e769e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:21:11Z,use_quota=True,user_id='36af494ff70b4749b5bf2f837c481984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8367cc35-ab36-4f0c-a282-edf2b624ada3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8367cc35-ab36-4f0c-a282-edf2b624ada3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa8fc07-7d97-46f6-8545-c3c990436544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa8fc07-7d97-46f6-8545-c3c990436544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d382c52-ae35-48de-8c74-47474411bcc0', 'volume_name': 'volume-6d382c52-ae35-48de-8c74-47474411bcc0', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd33a56d-07cc-4f55-b077-475ab3e1cce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd33a56d-07cc-4f55-b077-475ab3e1cce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d1565a8-fa11-408d-ba46-d8c696688e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:11 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Volume 6d382c52-ae35-48de-8c74-47474411bcc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d382c52-ae35-48de-8c74-47474411bcc0', 'volume_size': 1} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-772804361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d382c52-ae35-48de-8c74-47474411bcc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b37b17f91d4467b8159feb462e769e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:21:11Z,use_quota=True,user_id='36af494ff70b4749b5bf2f837c481984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Creating volume 6d382c52-ae35-48de-8c74-47474411bcc0 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:21:11 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:11 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c4980497-56fc-4515-8d4b-8e013e045dca tempest-AttachVolumeShelveTestJSON-1993120243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f57462a4-4598-4088-80a9-fc39e0aff319" returned: 0 in 0.865s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:11 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0 1073741824 Jul 07 17:21:11 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c4980497-56fc-4515-8d4b-8e013e045dca tempest-AttachVolumeShelveTestJSON-1993120243 None] Lock "cinder-quobyte-f57462a4-4598-4088-80a9-fc39e0aff319" released by "delete_volume" :: held 2.382s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-c4980497-56fc-4515-8d4b-8e013e045dca tempest-AttachVolumeShelveTestJSON-1993120243 None] Created reservations ['fbd7e55e-ecb4-4fe6-8ea4-787391750f23', '73b20d38-651e-4eb1-bcea-b8f34c07a23f', '170a245e-fafe-42ef-9503-9056e4b78a55', '0c42cfe2-0ed1-4c74-9463-b2b449a0956b'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c4980497-56fc-4515-8d4b-8e013e045dca tempest-AttachVolumeShelveTestJSON-1993120243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c4980497-56fc-4515-8d4b-8e013e045dca tempest-AttachVolumeShelveTestJSON-1993120243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c4980497-56fc-4515-8d4b-8e013e045dca tempest-AttachVolumeShelveTestJSON-1993120243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c4980497-56fc-4515-8d4b-8e013e045dca tempest-AttachVolumeShelveTestJSON-1993120243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c4980497-56fc-4515-8d4b-8e013e045dca tempest-AttachVolumeShelveTestJSON-1993120243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c4980497-56fc-4515-8d4b-8e013e045dca tempest-AttachVolumeShelveTestJSON-1993120243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:11 devstack sudo[91170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:21:11 devstack sudo[91170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:12 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0 1073741824" returned: 0 in 1.170s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:12 devstack sudo[91177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0 Jul 07 17:21:12 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:12 devstack sudo[91170]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c4980497-56fc-4515-8d4b-8e013e045dca tempest-AttachVolumeShelveTestJSON-1993120243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.185s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:12 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-c4980497-56fc-4515-8d4b-8e013e045dca tempest-AttachVolumeShelveTestJSON-1993120243 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:21:12 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-c4980497-56fc-4515-8d4b-8e013e045dca tempest-AttachVolumeShelveTestJSON-1993120243 None] Deleted volume successfully. Jul 07 17:21:12 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c4980497-56fc-4515-8d4b-8e013e045dca tempest-AttachVolumeShelveTestJSON-1993120243 None] Lock "cinder-f57462a4-4598-4088-80a9-fc39e0aff319-delete_volume" released by "delete_volume" :: held 3.912s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:21:13 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0" returned: 0 in 1.163s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] <== create_volume: return (2425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:21:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.429s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d1565a8-fa11-408d-ba46-d8c696688e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d382c52-ae35-48de-8c74-47474411bcc0', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af72f40-1e1a-49b2-95a4-865099885e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:13 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Volume volume-6d382c52-ae35-48de-8c74-47474411bcc0 (6d382c52-ae35-48de-8c74-47474411bcc0): created successfully Jul 07 17:21:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af72f40-1e1a-49b2-95a4-865099885e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Flow 'volume_create_manager' (301b5349-1b9c-4fbc-8897-c7f64b84e4f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:21:13 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-935a4fdd-ce01-4dc4-93be-9c0197f4db5c tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Created volume successfully. Jul 07 17:21:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-965c13f1-0260-4dfd-99f2-5fee4032e050 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-965c13f1-0260-4dfd-99f2-5fee4032e050 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-965c13f1-0260-4dfd-99f2-5fee4032e050 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Creating offline snapshot 6fadab29-75f5-4b5f-873c-b43444f31b48 of volume 6d382c52-ae35-48de-8c74-47474411bcc0 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:21:14 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb7a0fc-db94-4bc8-be41-f7e374eaf5bc]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-965c13f1-0260-4dfd-99f2-5fee4032e050 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:14 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0 Jul 07 17:21:14 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:15 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-965c13f1-0260-4dfd-99f2-5fee4032e050 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0" returned: 0 in 1.135s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-965c13f1-0260-4dfd-99f2-5fee4032e050 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.6fadab29-75f5-4b5f-873c-b43444f31b48 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:15 devstack sudo[91195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.6fadab29-75f5-4b5f-873c-b43444f31b48 1G Jul 07 17:21:15 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:16 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-965c13f1-0260-4dfd-99f2-5fee4032e050 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.6fadab29-75f5-4b5f-873c-b43444f31b48 1G" returned: 0 in 1.012s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-965c13f1-0260-4dfd-99f2-5fee4032e050 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d382c52-ae35-48de-8c74-47474411bcc0 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.6fadab29-75f5-4b5f-873c-b43444f31b48 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:16 devstack sudo[91201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d382c52-ae35-48de-8c74-47474411bcc0 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.6fadab29-75f5-4b5f-873c-b43444f31b48 Jul 07 17:21:16 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:17 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-965c13f1-0260-4dfd-99f2-5fee4032e050 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d382c52-ae35-48de-8c74-47474411bcc0 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.6fadab29-75f5-4b5f-873c-b43444f31b48" returned: 0 in 0.834s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:17 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-965c13f1-0260-4dfd-99f2-5fee4032e050 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.6fadab29-75f5-4b5f-873c-b43444f31b48 is being set with open permissions: ugo+rw Jul 07 17:21:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-965c13f1-0260-4dfd-99f2-5fee4032e050 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.6fadab29-75f5-4b5f-873c-b43444f31b48 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:17 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.6fadab29-75f5-4b5f-873c-b43444f31b48 Jul 07 17:21:17 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:18 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-965c13f1-0260-4dfd-99f2-5fee4032e050 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.6fadab29-75f5-4b5f-873c-b43444f31b48" returned: 0 in 0.791s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-965c13f1-0260-4dfd-99f2-5fee4032e050 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:18 devstack sudo[91210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.info Jul 07 17:21:18 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:19 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-965c13f1-0260-4dfd-99f2-5fee4032e050 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.info" returned: 0 in 0.706s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:19 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-965c13f1-0260-4dfd-99f2-5fee4032e050 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.info is being set with open permissions: ugo+rw Jul 07 17:21:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-965c13f1-0260-4dfd-99f2-5fee4032e050 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:19 devstack sudo[91213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.info Jul 07 17:21:19 devstack sudo[91213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:19 devstack sudo[91213]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-965c13f1-0260-4dfd-99f2-5fee4032e050 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.info" returned: 0 in 0.720s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-965c13f1-0260-4dfd-99f2-5fee4032e050 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.307s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:19 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-965c13f1-0260-4dfd-99f2-5fee4032e050 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Create snapshot completed successfully Jul 07 17:21:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d4f0aa85-d915-400d-b633-d5fab0a3a246 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Acquiring lock "cinder-6fadab29-75f5-4b5f-873c-b43444f31b48-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d4f0aa85-d915-400d-b633-d5fab0a3a246 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Lock "cinder-6fadab29-75f5-4b5f-873c-b43444f31b48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d4f0aa85-d915-400d-b633-d5fab0a3a246 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Acquiring lock "cinder-quobyte-6d382c52-ae35-48de-8c74-47474411bcc0" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d4f0aa85-d915-400d-b633-d5fab0a3a246 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Lock "cinder-quobyte-6d382c52-ae35-48de-8c74-47474411bcc0" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d4f0aa85-d915-400d-b633-d5fab0a3a246 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Acquiring lock "cinder-quobyte-6fadab29-75f5-4b5f-873c-b43444f31b48" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d4f0aa85-d915-400d-b633-d5fab0a3a246 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Lock "cinder-quobyte-6fadab29-75f5-4b5f-873c-b43444f31b48" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-d4f0aa85-d915-400d-b633-d5fab0a3a246 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Deleting offline snapshot 6fadab29-75f5-4b5f-873c-b43444f31b48 of volume 6d382c52-ae35-48de-8c74-47474411bcc0 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:21:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-d4f0aa85-d915-400d-b633-d5fab0a3a246 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] snapshot_file for this snap is: volume-6d382c52-ae35-48de-8c74-47474411bcc0.6fadab29-75f5-4b5f-873c-b43444f31b48 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:21:21 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a61642-acb1-4985-8f30-3997422418aa]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d4f0aa85-d915-400d-b633-d5fab0a3a246 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.6fadab29-75f5-4b5f-873c-b43444f31b48 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:21 devstack sudo[91218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.6fadab29-75f5-4b5f-873c-b43444f31b48 Jul 07 17:21:21 devstack sudo[91218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:22 devstack sudo[91218]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d4f0aa85-d915-400d-b633-d5fab0a3a246 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.6fadab29-75f5-4b5f-873c-b43444f31b48" returned: 0 in 1.170s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-d4f0aa85-d915-400d-b633-d5fab0a3a246 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d382c52-ae35-48de-8c74-47474411bcc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:21:23 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[e647a5c8-7477-4591-a85e-5b3bf443fdbd]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d4f0aa85-d915-400d-b633-d5fab0a3a246 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:23 devstack sudo[91226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0 Jul 07 17:21:23 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:23 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d4f0aa85-d915-400d-b633-d5fab0a3a246 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0" returned: 0 in 0.876s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d4f0aa85-d915-400d-b633-d5fab0a3a246 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.6fadab29-75f5-4b5f-873c-b43444f31b48 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:23 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.6fadab29-75f5-4b5f-873c-b43444f31b48 Jul 07 17:21:23 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:24 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d4f0aa85-d915-400d-b633-d5fab0a3a246 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.6fadab29-75f5-4b5f-873c-b43444f31b48" returned: 0 in 1.005s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d4f0aa85-d915-400d-b633-d5fab0a3a246 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.6fadab29-75f5-4b5f-873c-b43444f31b48 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:24 devstack sudo[91240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.6fadab29-75f5-4b5f-873c-b43444f31b48 Jul 07 17:21:24 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:25 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d4f0aa85-d915-400d-b633-d5fab0a3a246 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0.6fadab29-75f5-4b5f-873c-b43444f31b48" returned: 0 in 0.807s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d4f0aa85-d915-400d-b633-d5fab0a3a246 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Lock "cinder-quobyte-6fadab29-75f5-4b5f-873c-b43444f31b48" released by "_delete_snapshot" :: held 4.030s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:21:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d4f0aa85-d915-400d-b633-d5fab0a3a246 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Lock "cinder-quobyte-6d382c52-ae35-48de-8c74-47474411bcc0" released by "delete_snapshot" :: held 4.065s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:21:25 devstack cinder-volume[87303]: WARNING cinder.quota [None req-d4f0aa85-d915-400d-b633-d5fab0a3a246 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:21:25 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-d4f0aa85-d915-400d-b633-d5fab0a3a246 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Created reservations ['6fc018b3-6f2c-4633-8c54-a2aad560caf0', 'ed74df2b-1c91-4482-9640-4d9d7fe8aeed', '935e371a-77a3-437d-8cc7-3082741557c7', 'fd5ec3f7-35d9-4ddd-a7dd-3fe1d08f1a84'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:21:25 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-d4f0aa85-d915-400d-b633-d5fab0a3a246 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Delete snapshot completed successfully. Jul 07 17:21:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d4f0aa85-d915-400d-b633-d5fab0a3a246 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Lock "cinder-6fadab29-75f5-4b5f-873c-b43444f31b48-delete_snapshot" released by "delete_snapshot" :: held 4.257s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:21:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-315d3692-cc5f-4ee8-9801-899099233fa4 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Acquiring lock "cinder-6d382c52-ae35-48de-8c74-47474411bcc0-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-315d3692-cc5f-4ee8-9801-899099233fa4 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Lock "cinder-6d382c52-ae35-48de-8c74-47474411bcc0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-315d3692-cc5f-4ee8-9801-899099233fa4 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Acquiring lock "cinder-quobyte-6d382c52-ae35-48de-8c74-47474411bcc0" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-315d3692-cc5f-4ee8-9801-899099233fa4 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Lock "cinder-quobyte-6d382c52-ae35-48de-8c74-47474411bcc0" acquired by "delete_volume" :: waited 0.044s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:27 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0833525-298e-4812-8841-73f004842c1a]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-315d3692-cc5f-4ee8-9801-899099233fa4 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:27 devstack sudo[91264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0 Jul 07 17:21:27 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:28 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5ddf909f-1551-43ed-b4a4-1d9916854196 tempest-GroupsTest-2093467214 None] Group tempest-Group1-1857079560: creating Jul 07 17:21:28 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5ddf909f-1551-43ed-b4a4-1d9916854196 tempest-GroupsTest-2093467214 None] Group tempest-Group1-1857079560: created successfully Jul 07 17:21:28 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5ddf909f-1551-43ed-b4a4-1d9916854196 tempest-GroupsTest-2093467214 None] Create group completed successfully. Jul 07 17:21:28 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-315d3692-cc5f-4ee8-9801-899099233fa4 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0" returned: 0 in 1.198s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-315d3692-cc5f-4ee8-9801-899099233fa4 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:28 devstack sudo[91275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0 Jul 07 17:21:28 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:29 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-ba796926-17fd-4b31-b600-67f73c2e8475 tempest-GroupsTest-2093467214 None] Group tempest-Group2-763893104: creating Jul 07 17:21:29 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-315d3692-cc5f-4ee8-9801-899099233fa4 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d382c52-ae35-48de-8c74-47474411bcc0" returned: 0 in 0.976s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:29 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-ba796926-17fd-4b31-b600-67f73c2e8475 tempest-GroupsTest-2093467214 None] Group tempest-Group2-763893104: created successfully Jul 07 17:21:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-315d3692-cc5f-4ee8-9801-899099233fa4 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Lock "cinder-quobyte-6d382c52-ae35-48de-8c74-47474411bcc0" released by "delete_volume" :: held 2.311s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:21:29 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-ba796926-17fd-4b31-b600-67f73c2e8475 tempest-GroupsTest-2093467214 None] Create group completed successfully. Jul 07 17:21:29 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-315d3692-cc5f-4ee8-9801-899099233fa4 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Created reservations ['da0236e9-3ae9-4c93-b09f-16720360060c', 'f8724eb0-f09b-4e97-ac13-ce8320a6bac7', '7d7b6c7b-a56a-4a2a-be47-b9b846754a6b', 'fafc89fa-7d5b-4652-b28b-69056536f630'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:21:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-315d3692-cc5f-4ee8-9801-899099233fa4 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-315d3692-cc5f-4ee8-9801-899099233fa4 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-315d3692-cc5f-4ee8-9801-899099233fa4 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-315d3692-cc5f-4ee8-9801-899099233fa4 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-315d3692-cc5f-4ee8-9801-899099233fa4 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-315d3692-cc5f-4ee8-9801-899099233fa4 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:29 devstack sudo[91285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:21:29 devstack sudo[91285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:30 devstack sudo[91285]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-315d3692-cc5f-4ee8-9801-899099233fa4 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.773s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:30 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-315d3692-cc5f-4ee8-9801-899099233fa4 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:21:30 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-315d3692-cc5f-4ee8-9801-899099233fa4 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Deleted volume successfully. Jul 07 17:21:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-315d3692-cc5f-4ee8-9801-899099233fa4 tempest-VolumeSnapshotQuotasNegativeTestJSON-171406531 None] Lock "cinder-6d382c52-ae35-48de-8c74-47474411bcc0-delete_volume" released by "delete_volume" :: held 3.524s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:21:31 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:21:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Flow 'volume_create_manager' (2e45d843-085c-4b69-9521-b90392be8da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:21:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49eec991-19d1-432d-8e26-98bf3ee06b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49eec991-19d1-432d-8e26-98bf3ee06b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1017055290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f381804-65e0-426c-9752-29104e0a8325,host='devstack@QuobyteHD#QuobyteHD',id=0d254c4a-37ee-4839-a97f-ecceff9663f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67898083da3c4f2d98ceebbba50c1c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:21:31Z,use_quota=True,user_id='6c99b89400b14e9e954ea2413d6505d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4549b980-e5d0-4f98-a7b6-777ad8916695),volume_type_id=4549b980-e5d0-4f98-a7b6-777ad8916695)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a2e271-be1a-43d1-a013-007b4976193a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a2e271-be1a-43d1-a013-007b4976193a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725ab99b-4183-4fbc-b8aa-6ccdc4f004f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725ab99b-4183-4fbc-b8aa-6ccdc4f004f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d254c4a-37ee-4839-a97f-ecceff9663f1', 'volume_name': 'volume-0d254c4a-37ee-4839-a97f-ecceff9663f1', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a484438b-143c-4ea9-850a-b8be7bd0fb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a484438b-143c-4ea9-850a-b8be7bd0fb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (446dd27d-0629-47c6-98f0-1f43629c316b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:31 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Volume 0d254c4a-37ee-4839-a97f-ecceff9663f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d254c4a-37ee-4839-a97f-ecceff9663f1', 'volume_size': 1} Jul 07 17:21:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4f381804-65e0-426c-9752-29104e0a8325,created_at=2026-07-07T15:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1017055290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f381804-65e0-426c-9752-29104e0a8325,host='devstack@QuobyteHD#QuobyteHD',id=0d254c4a-37ee-4839-a97f-ecceff9663f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67898083da3c4f2d98ceebbba50c1c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:21:31Z,use_quota=True,user_id='6c99b89400b14e9e954ea2413d6505d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4549b980-e5d0-4f98-a7b6-777ad8916695),volume_type_id=4549b980-e5d0-4f98-a7b6-777ad8916695)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:21:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Creating volume 0d254c4a-37ee-4839-a97f-ecceff9663f1 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:21:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:21:31 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:21:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0d254c4a-37ee-4839-a97f-ecceff9663f1 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:31 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0d254c4a-37ee-4839-a97f-ecceff9663f1 1073741824 Jul 07 17:21:31 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:32 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0d254c4a-37ee-4839-a97f-ecceff9663f1 1073741824" returned: 0 in 1.100s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0d254c4a-37ee-4839-a97f-ecceff9663f1 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:32 devstack sudo[91312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0d254c4a-37ee-4839-a97f-ecceff9663f1 Jul 07 17:21:32 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:33 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0d254c4a-37ee-4839-a97f-ecceff9663f1" returned: 0 in 0.897s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:33 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:21:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.086s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (446dd27d-0629-47c6-98f0-1f43629c316b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d254c4a-37ee-4839-a97f-ecceff9663f1', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10493d9b-4885-4aaa-90e5-e697034671c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:33 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Volume volume-0d254c4a-37ee-4839-a97f-ecceff9663f1 (0d254c4a-37ee-4839-a97f-ecceff9663f1): created successfully Jul 07 17:21:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10493d9b-4885-4aaa-90e5-e697034671c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Flow 'volume_create_manager' (2e45d843-085c-4b69-9521-b90392be8da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:21:33 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-734035ce-2e6e-470c-98d5-e58c9e03b2d1 tempest-GroupsTest-2093467214 None] Created volume successfully. Jul 07 17:21:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b51df4b0-ad09-4cd0-bdc9-c3af4c6dce13 tempest-GroupsTest-2093467214 None] Acquiring lock "cinder-quobyte-0d254c4a-37ee-4839-a97f-ecceff9663f1" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b51df4b0-ad09-4cd0-bdc9-c3af4c6dce13 tempest-GroupsTest-2093467214 None] Lock "cinder-quobyte-0d254c4a-37ee-4839-a97f-ecceff9663f1" acquired by "delete_volume" :: waited 0.040s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:35 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd37f384-3045-4cac-bfce-6ef9def8b908]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b51df4b0-ad09-4cd0-bdc9-c3af4c6dce13 tempest-GroupsTest-2093467214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0d254c4a-37ee-4839-a97f-ecceff9663f1 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:36 devstack sudo[91414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0d254c4a-37ee-4839-a97f-ecceff9663f1 Jul 07 17:21:36 devstack sudo[91414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:37 devstack sudo[91414]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b51df4b0-ad09-4cd0-bdc9-c3af4c6dce13 tempest-GroupsTest-2093467214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0d254c4a-37ee-4839-a97f-ecceff9663f1" returned: 0 in 1.494s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b51df4b0-ad09-4cd0-bdc9-c3af4c6dce13 tempest-GroupsTest-2093467214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0d254c4a-37ee-4839-a97f-ecceff9663f1 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:37 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0d254c4a-37ee-4839-a97f-ecceff9663f1 Jul 07 17:21:37 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:38 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b51df4b0-ad09-4cd0-bdc9-c3af4c6dce13 tempest-GroupsTest-2093467214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0d254c4a-37ee-4839-a97f-ecceff9663f1" returned: 0 in 1.176s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:38 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b51df4b0-ad09-4cd0-bdc9-c3af4c6dce13 tempest-GroupsTest-2093467214 None] Lock "cinder-quobyte-0d254c4a-37ee-4839-a97f-ecceff9663f1" released by "delete_volume" :: held 2.813s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:21:38 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-b51df4b0-ad09-4cd0-bdc9-c3af4c6dce13 tempest-GroupsTest-2093467214 None] Created reservations ['80a64570-0b7c-418f-af8a-f34b34f70032'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:21:38 devstack cinder-volume[87303]: WARNING cinder.quota [None req-b51df4b0-ad09-4cd0-bdc9-c3af4c6dce13 tempest-GroupsTest-2093467214 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1421551625 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1421551625, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:21:38 devstack cinder-volume[87303]: WARNING cinder.quota [None req-b51df4b0-ad09-4cd0-bdc9-c3af4c6dce13 tempest-GroupsTest-2093467214 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1421551625 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1421551625, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:21:38 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-b51df4b0-ad09-4cd0-bdc9-c3af4c6dce13 tempest-GroupsTest-2093467214 None] Created reservations ['c60c4d94-1da6-422a-ab0d-2e01d034852f', '49ad8e7d-0c5b-4c7d-b4c8-64008dda3934', '8a7f1231-8aa9-4966-9be4-e617d89eb308', 'be1602e2-e779-4f46-8788-4101039877e5'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:21:39 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:21:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Flow 'volume_create_manager' (11da6dde-7a9e-4a47-a699-74c6bc7f5a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:21:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fa0b59-6d84-47fd-8556-91e8c3e0eeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b51df4b0-ad09-4cd0-bdc9-c3af4c6dce13 tempest-GroupsTest-2093467214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b51df4b0-ad09-4cd0-bdc9-c3af4c6dce13 tempest-GroupsTest-2093467214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:39 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b51df4b0-ad09-4cd0-bdc9-c3af4c6dce13 tempest-GroupsTest-2093467214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:39 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b51df4b0-ad09-4cd0-bdc9-c3af4c6dce13 tempest-GroupsTest-2093467214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b51df4b0-ad09-4cd0-bdc9-c3af4c6dce13 tempest-GroupsTest-2093467214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b51df4b0-ad09-4cd0-bdc9-c3af4c6dce13 tempest-GroupsTest-2093467214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fa0b59-6d84-47fd-8556-91e8c3e0eeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1916775830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38cfdd94-98be-45e9-8ee7-6e9d4bf0b078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3c743a3ee104746a901aa5c9aa3f783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:21:39Z,use_quota=True,user_id='5e6a359fc75941debea555e94bf07adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f909d6-e50e-4c87-ad9e-6e59f5837cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f909d6-e50e-4c87-ad9e-6e59f5837cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36113d7b-e644-4f4f-988f-be1aed526042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:39 devstack cinder-volume[87303]: DEBUG cinder.image.glance [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Creating Keystone auth plugin from conf {{(pid=87303) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:21:39 devstack sudo[91429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:21:39 devstack sudo[91429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36113d7b-e644-4f4f-988f-be1aed526042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '38cfdd94-98be-45e9-8ee7-6e9d4bf0b078', 'volume_name': 'volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078', 'volume_size': 1, 'image_id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '209334a192ee4ec7a4a563a01fc9db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/919a0971-57b8-4ecd-833d-de05e9b603e2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0f8183e-24fc-4c86-a0ba-452d91474dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0f8183e-24fc-4c86-a0ba-452d91474dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1fcfdb-d8b3-40a4-a38b-a6f5e1d5fda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:40 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Volume 38cfdd94-98be-45e9-8ee7-6e9d4bf0b078: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078', 'volume_size': 1, 'image_id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '209334a192ee4ec7a4a563a01fc9db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/919a0971-57b8-4ecd-833d-de05e9b603e2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 17:21:40 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Trying to clone 38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 from image 919a0971-57b8-4ecd-833d-de05e9b603e2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}]). {{(pid=87303) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:21:40 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-5ae31b82-ad9b-48c1-9a56-ca4bb7645f16 tempest-GroupsTest-2093467214 None] Created reservations ['4c721e60-ba9f-4711-9d08-396c47b140a9'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:21:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5ae31b82-ad9b-48c1-9a56-ca4bb7645f16 tempest-GroupsTest-2093467214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5ae31b82-ad9b-48c1-9a56-ca4bb7645f16 tempest-GroupsTest-2093467214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:40 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5ae31b82-ad9b-48c1-9a56-ca4bb7645f16 tempest-GroupsTest-2093467214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:40 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5ae31b82-ad9b-48c1-9a56-ca4bb7645f16 tempest-GroupsTest-2093467214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5ae31b82-ad9b-48c1-9a56-ca4bb7645f16 tempest-GroupsTest-2093467214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5ae31b82-ad9b-48c1-9a56-ca4bb7645f16 tempest-GroupsTest-2093467214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:40 devstack sudo[91438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:21:40 devstack sudo[91438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:40 devstack sudo[91429]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b51df4b0-ad09-4cd0-bdc9-c3af4c6dce13 tempest-GroupsTest-2093467214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.606s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:40 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-b51df4b0-ad09-4cd0-bdc9-c3af4c6dce13 tempest-GroupsTest-2093467214 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:21:40 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b51df4b0-ad09-4cd0-bdc9-c3af4c6dce13 tempest-GroupsTest-2093467214 None] Delete group completed successfully. Jul 07 17:21:41 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_iqeciqiidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:21:41 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Image download 20.69 MB at 20.69 MB/s Jul 07 17:21:41 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fb4eed-e107-4b20-8bff-812bb20b3628]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_iqeciqiidevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:41 devstack sudo[91461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_iqeciqiidevstack@QuobyteHD Jul 07 17:21:41 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:41 devstack sudo[91438]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5ae31b82-ad9b-48c1-9a56-ca4bb7645f16 tempest-GroupsTest-2093467214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.482s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:41 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-5ae31b82-ad9b-48c1-9a56-ca4bb7645f16 tempest-GroupsTest-2093467214 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:21:41 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5ae31b82-ad9b-48c1-9a56-ca4bb7645f16 tempest-GroupsTest-2093467214 None] Delete group completed successfully. Jul 07 17:21:42 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_iqeciqiidevstack@QuobyteHD" returned: 0 in 1.439s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:42 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Temporary image 919a0971-57b8-4ecd-833d-de05e9b603e2 is fetched for user 5e6a359fc75941debea555e94bf07adf. {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:21:42 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[74de04ee-82fa-4837-857a-21addfa316f7]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_iqeciqiidevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:42 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-70e53e31-2249-413e-8fdb-5be45db32248 tempest-GroupsTest-2093467214 None] Group tempest-GroupsTest-Group-308627285: creating Jul 07 17:21:42 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-70e53e31-2249-413e-8fdb-5be45db32248 tempest-GroupsTest-2093467214 None] Group tempest-GroupsTest-Group-308627285: created successfully Jul 07 17:21:42 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-70e53e31-2249-413e-8fdb-5be45db32248 tempest-GroupsTest-2093467214 None] Create group completed successfully. Jul 07 17:21:42 devstack sudo[91470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_iqeciqiidevstack@QuobyteHD Jul 07 17:21:42 devstack sudo[91470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:43 devstack sudo[91470]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_iqeciqiidevstack@QuobyteHD" returned: 0 in 0.865s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:43 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1916775830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38cfdd94-98be-45e9-8ee7-6e9d4bf0b078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3c743a3ee104746a901aa5c9aa3f783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:21:39Z,use_quota=True,user_id='5e6a359fc75941debea555e94bf07adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:21:43 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Creating volume 38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:21:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:43 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:43 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:43 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:21:43 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:21:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:43 devstack sudo[91476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 1073741824 Jul 07 17:21:43 devstack sudo[91476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:44 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:21:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Flow 'volume_create_manager' (b09bc927-050a-49ef-a309-868f32c18631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:21:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71def01-a58d-411e-8bbf-8cc163df8cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71def01-a58d-411e-8bbf-8cc163df8cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1627463169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=355a1105-a744-47df-9e27-735f05147151,host='devstack@QuobyteHD#QuobyteHD',id=eef73e68-9748-4562-b038-8981857770ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67898083da3c4f2d98ceebbba50c1c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:21:45Z,use_quota=True,user_id='6c99b89400b14e9e954ea2413d6505d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34e8affe-e142-4120-95a2-e21e3c675ef7),volume_type_id=34e8affe-e142-4120-95a2-e21e3c675ef7)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ee63ff-b412-406b-9501-a9e8e4508224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ee63ff-b412-406b-9501-a9e8e4508224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8a2f0a-3c9c-4c92-a17a-f5c341333bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8a2f0a-3c9c-4c92-a17a-f5c341333bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eef73e68-9748-4562-b038-8981857770ce', 'volume_name': 'volume-eef73e68-9748-4562-b038-8981857770ce', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:44 devstack sudo[91476]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6167c261-98b6-4172-ba0d-233830f99f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6167c261-98b6-4172-ba0d-233830f99f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f076e75-1cd0-4999-858c-8e0079619898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:44 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Volume eef73e68-9748-4562-b038-8981857770ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eef73e68-9748-4562-b038-8981857770ce', 'volume_size': 1} Jul 07 17:21:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 1073741824" returned: 0 in 1.332s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:45 devstack sudo[91482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 Jul 07 17:21:45 devstack sudo[91482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:45 devstack sudo[91482]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078" returned: 0 in 0.747s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] <== create_volume: return (2140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:21:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.144s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.803s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=355a1105-a744-47df-9e27-735f05147151,created_at=2026-07-07T15:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1627463169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=355a1105-a744-47df-9e27-735f05147151,host='devstack@QuobyteHD#QuobyteHD',id=eef73e68-9748-4562-b038-8981857770ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67898083da3c4f2d98ceebbba50c1c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:21:45Z,use_quota=True,user_id='6c99b89400b14e9e954ea2413d6505d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34e8affe-e142-4120-95a2-e21e3c675ef7),volume_type_id=34e8affe-e142-4120-95a2-e21e3c675ef7)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:21:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Creating volume eef73e68-9748-4562-b038-8981857770ce {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:21:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:21:45 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:21:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eef73e68-9748-4562-b038-8981857770ce 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:45 devstack sudo[91485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eef73e68-9748-4562-b038-8981857770ce 1073741824 Jul 07 17:21:45 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:45 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Attempting download of 919a0971-57b8-4ecd-833d-de05e9b603e2 ((None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}])) to volume 38cfdd94-98be-45e9-8ee7-6e9d4bf0b078. {{(pid=87303) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:21:45 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee95a717-e0b9-4db3-8187-69f001a5f04a]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_d019wru2 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:46 devstack sudo[91487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_d019wru2 Jul 07 17:21:46 devstack sudo[91487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:46 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eef73e68-9748-4562-b038-8981857770ce 1073741824" returned: 0 in 0.973s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eef73e68-9748-4562-b038-8981857770ce {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:46 devstack sudo[91493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eef73e68-9748-4562-b038-8981857770ce Jul 07 17:21:46 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:47 devstack sudo[91487]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_d019wru2" returned: 0 in 1.248s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_d019wru2 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:47 devstack sudo[91497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_d019wru2 Jul 07 17:21:47 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:48 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eef73e68-9748-4562-b038-8981857770ce" returned: 0 in 1.242s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] <== create_volume: return (2315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:21:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.321s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f076e75-1cd0-4999-858c-8e0079619898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eef73e68-9748-4562-b038-8981857770ce', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b9da6d-370f-4a0c-b364-380d9965257d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:48 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Volume volume-eef73e68-9748-4562-b038-8981857770ce (eef73e68-9748-4562-b038-8981857770ce): created successfully Jul 07 17:21:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b9da6d-370f-4a0c-b364-380d9965257d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Flow 'volume_create_manager' (b09bc927-050a-49ef-a309-868f32c18631) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:21:48 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-e7b3404f-c0af-4470-9d8d-ae2f72e890af tempest-GroupsTest-2093467214 None] Created volume successfully. Jul 07 17:21:48 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_d019wru2" returned: 1 in 1.522s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_d019wru2' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:21:48 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bb36b3-0308-47a0-ba29-6473fc510604]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_iqeciqiidevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:48 devstack sudo[91509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_iqeciqiidevstack@QuobyteHD Jul 07 17:21:48 devstack sudo[91509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:49 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:21:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Flow 'volume_create_manager' (bfaff08d-bbb2-4c17-87f9-b5a60b4f6bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:21:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd738c3-e995-4a9c-bcb9-deb64cfdebce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd738c3-e995-4a9c-bcb9-deb64cfdebce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1890625300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=355a1105-a744-47df-9e27-735f05147151,host='devstack@QuobyteHD#QuobyteHD',id=75794e56-53ba-45c6-9d6c-f29651d0019c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67898083da3c4f2d98ceebbba50c1c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:21:50Z,use_quota=True,user_id='6c99b89400b14e9e954ea2413d6505d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34e8affe-e142-4120-95a2-e21e3c675ef7),volume_type_id=34e8affe-e142-4120-95a2-e21e3c675ef7)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da3ead1-ea3f-46a0-94da-f2ee9e8a9b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da3ead1-ea3f-46a0-94da-f2ee9e8a9b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5043c6d5-2f8c-4370-a321-759cd264f06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5043c6d5-2f8c-4370-a321-759cd264f06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75794e56-53ba-45c6-9d6c-f29651d0019c', 'volume_name': 'volume-75794e56-53ba-45c6-9d6c-f29651d0019c', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5813b8d2-e9fe-45a6-bfb7-03acaaa0b097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5813b8d2-e9fe-45a6-bfb7-03acaaa0b097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896a8051-9eb6-435d-bdd8-c0252eba8118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:49 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Volume 75794e56-53ba-45c6-9d6c-f29651d0019c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75794e56-53ba-45c6-9d6c-f29651d0019c', 'volume_size': 1} Jul 07 17:21:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=355a1105-a744-47df-9e27-735f05147151,created_at=2026-07-07T15:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1890625300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=355a1105-a744-47df-9e27-735f05147151,host='devstack@QuobyteHD#QuobyteHD',id=75794e56-53ba-45c6-9d6c-f29651d0019c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67898083da3c4f2d98ceebbba50c1c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:21:50Z,use_quota=True,user_id='6c99b89400b14e9e954ea2413d6505d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34e8affe-e142-4120-95a2-e21e3c675ef7),volume_type_id=34e8affe-e142-4120-95a2-e21e3c675ef7)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:21:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Creating volume 75794e56-53ba-45c6-9d6c-f29651d0019c {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:21:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:21:49 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:21:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75794e56-53ba-45c6-9d6c-f29651d0019c 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:49 devstack sudo[91541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75794e56-53ba-45c6-9d6c-f29651d0019c 1073741824 Jul 07 17:21:49 devstack sudo[91541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:50 devstack sudo[91509]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_iqeciqiidevstack@QuobyteHD" returned: 0 in 1.655s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:50 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] 919a0971-57b8-4ecd-833d-de05e9b603e2 was qcow2, converting to raw {{(pid=87303) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:21:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_iqeciqiidevstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:50 devstack sudo[91549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_iqeciqiidevstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 Jul 07 17:21:50 devstack sudo[91549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:50 devstack sudo[91541]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75794e56-53ba-45c6-9d6c-f29651d0019c 1073741824" returned: 0 in 1.027s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75794e56-53ba-45c6-9d6c-f29651d0019c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:50 devstack sudo[91558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75794e56-53ba-45c6-9d6c-f29651d0019c Jul 07 17:21:50 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:51 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75794e56-53ba-45c6-9d6c-f29651d0019c" returned: 0 in 0.710s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:21:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:51 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896a8051-9eb6-435d-bdd8-c0252eba8118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75794e56-53ba-45c6-9d6c-f29651d0019c', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:51 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f68301a-2583-4b4a-b363-09174072e93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:51 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Volume volume-75794e56-53ba-45c6-9d6c-f29651d0019c (75794e56-53ba-45c6-9d6c-f29651d0019c): created successfully Jul 07 17:21:51 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f68301a-2583-4b4a-b363-09174072e93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:51 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Flow 'volume_create_manager' (bfaff08d-bbb2-4c17-87f9-b5a60b4f6bfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:21:51 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-ba3d68ca-8089-4bd2-a5c9-b7d73374b53e tempest-GroupsTest-2093467214 None] Created volume successfully. Jul 07 17:21:52 devstack sudo[91549]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_iqeciqiidevstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078" returned: 0 in 2.292s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:52 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_iqeciqiidevstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:21:52 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Converted 112.00 MB image at 48.85 MB/s Jul 07 17:21:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:52 devstack sudo[91564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 1G Jul 07 17:21:52 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:52 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-68778276-0ef9-4193-959b-8f33c69142fb tempest-GroupsTest-2093467214 None] Update group completed successfully. Jul 07 17:21:53 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 1G" returned: 0 in 0.701s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:53 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c2acef-c94a-4070-9f83-e630bd4a45b2]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:53 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 Jul 07 17:21:53 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:54 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-e3d4d799-d4e4-4ed5-804c-50053db59d7b tempest-GroupsTest-2093467214 None] Update group completed successfully. Jul 07 17:21:54 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078" returned: 0 in 1.144s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:54 devstack sudo[91625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 Jul 07 17:21:54 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:55 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078" returned: 1 in 0.841s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:21:55 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Downloaded image 919a0971-57b8-4ecd-833d-de05e9b603e2 ((None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}])) to volume 38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 successfully. {{(pid=87303) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:21:55 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Temporary image 919a0971-57b8-4ecd-833d-de05e9b603e2 for user 5e6a359fc75941debea555e94bf07adf is deleted. {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:21:55 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Marking volume 38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 as bootable. {{(pid=87303) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:21:55 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Copying metadata from image 919a0971-57b8-4ecd-833d-de05e9b603e2 to 38cfdd94-98be-45e9-8ee7-6e9d4bf0b078. {{(pid=87303) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:21:55 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Creating volume glance metadata for volume 38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 backed by image 919a0971-57b8-4ecd-833d-de05e9b603e2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87303) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:21:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1fcfdb-d8b3-40a4-a38b-a6f5e1d5fda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078', 'volume_size': 1, 'image_id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '209334a192ee4ec7a4a563a01fc9db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/919a0971-57b8-4ecd-833d-de05e9b603e2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c82646-2b1f-4ef4-96a8-c822e755c303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:21:55 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Volume volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 (38cfdd94-98be-45e9-8ee7-6e9d4bf0b078): created successfully Jul 07 17:21:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c82646-2b1f-4ef4-96a8-c822e755c303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:21:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Flow 'volume_create_manager' (11da6dde-7a9e-4a47-a699-74c6bc7f5a7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:21:55 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-61d82a4f-0fcf-463a-99c1-00a57c16f9b9 tempest-VolumesImageMetadata-102042781 None] Created volume successfully. Jul 07 17:21:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] Acquiring lock "cinder-quobyte-75794e56-53ba-45c6-9d6c-f29651d0019c" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] Lock "cinder-quobyte-75794e56-53ba-45c6-9d6c-f29651d0019c" acquired by "delete_volume" :: waited 0.035s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:56 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de5d5a7-c14c-468d-b2f8-b8d1adb22c62]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75794e56-53ba-45c6-9d6c-f29651d0019c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-324a4cc7-8f60-4326-bc48-bd918b77b105 tempest-VolumesImageMetadata-102042781 None] Acquiring lock "cinder-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:56 devstack sudo[91650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75794e56-53ba-45c6-9d6c-f29651d0019c Jul 07 17:21:56 devstack sudo[91650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-324a4cc7-8f60-4326-bc48-bd918b77b105 tempest-VolumesImageMetadata-102042781 None] Lock "cinder-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-324a4cc7-8f60-4326-bc48-bd918b77b105 tempest-VolumesImageMetadata-102042781 None] Acquiring lock "cinder-quobyte-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-324a4cc7-8f60-4326-bc48-bd918b77b105 tempest-VolumesImageMetadata-102042781 None] Lock "cinder-quobyte-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078" acquired by "delete_volume" :: waited 0.015s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:56 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[31430943-c5ae-4cd3-a3dc-c4215ab8e09b]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-324a4cc7-8f60-4326-bc48-bd918b77b105 tempest-VolumesImageMetadata-102042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:21:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:21:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:21:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:21:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:21:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:21:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:56 devstack sudo[91655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:21:56 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:56 devstack sudo[91654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 Jul 07 17:21:56 devstack sudo[91654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:57 devstack sudo[91650]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75794e56-53ba-45c6-9d6c-f29651d0019c" returned: 0 in 1.846s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75794e56-53ba-45c6-9d6c-f29651d0019c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:57 devstack sudo[91654]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:57 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-324a4cc7-8f60-4326-bc48-bd918b77b105 tempest-VolumesImageMetadata-102042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078" returned: 0 in 1.478s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:58 devstack sudo[91664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75794e56-53ba-45c6-9d6c-f29651d0019c Jul 07 17:21:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-324a4cc7-8f60-4326-bc48-bd918b77b105 tempest-VolumesImageMetadata-102042781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:58 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.389s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:58 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:21:58 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:21:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:21:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:21:58 devstack sudo[91666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 Jul 07 17:21:58 devstack sudo[91666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:59 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75794e56-53ba-45c6-9d6c-f29651d0019c" returned: 0 in 1.224s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] Lock "cinder-quobyte-75794e56-53ba-45c6-9d6c-f29651d0019c" released by "delete_volume" :: held 3.160s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:21:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] Acquiring lock "cinder-quobyte-eef73e68-9748-4562-b038-8981857770ce" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:21:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] Lock "cinder-quobyte-eef73e68-9748-4562-b038-8981857770ce" acquired by "delete_volume" :: waited 0.027s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:21:59 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fa723e-ba38-437f-9fdf-f5b901c05b9f]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:21:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eef73e68-9748-4562-b038-8981857770ce {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:59 devstack sudo[91666]: pam_unix(sudo:session): session closed for user root Jul 07 17:21:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-324a4cc7-8f60-4326-bc48-bd918b77b105 tempest-VolumesImageMetadata-102042781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078" returned: 1 in 1.374s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:21:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-324a4cc7-8f60-4326-bc48-bd918b77b105 tempest-VolumesImageMetadata-102042781 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:21:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-324a4cc7-8f60-4326-bc48-bd918b77b105 tempest-VolumesImageMetadata-102042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:21:59 devstack sudo[91673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078 Jul 07 17:21:59 devstack sudo[91673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:21:59 devstack sudo[91672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eef73e68-9748-4562-b038-8981857770ce Jul 07 17:21:59 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:00 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eef73e68-9748-4562-b038-8981857770ce" returned: 0 in 1.108s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eef73e68-9748-4562-b038-8981857770ce {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:00 devstack sudo[91673]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:00 devstack sudo[91682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eef73e68-9748-4562-b038-8981857770ce Jul 07 17:22:00 devstack sudo[91682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-324a4cc7-8f60-4326-bc48-bd918b77b105 tempest-VolumesImageMetadata-102042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078" returned: 0 in 1.026s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:00 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-324a4cc7-8f60-4326-bc48-bd918b77b105 tempest-VolumesImageMetadata-102042781 None] Lock "cinder-quobyte-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078" released by "delete_volume" :: held 4.003s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:00 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-324a4cc7-8f60-4326-bc48-bd918b77b105 tempest-VolumesImageMetadata-102042781 None] Created reservations ['c045b0b5-1c66-4dbb-a48a-159e9f3dc15e', '9cf0e6d7-4429-480f-8861-39b04612b043', 'b9f069e7-1a8e-4a8c-ad9c-4490053d2575', '6c1b03ad-c21d-4e86-90c3-f42cc1d9a4a3'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-324a4cc7-8f60-4326-bc48-bd918b77b105 tempest-VolumesImageMetadata-102042781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-324a4cc7-8f60-4326-bc48-bd918b77b105 tempest-VolumesImageMetadata-102042781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:00 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-324a4cc7-8f60-4326-bc48-bd918b77b105 tempest-VolumesImageMetadata-102042781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:00 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-324a4cc7-8f60-4326-bc48-bd918b77b105 tempest-VolumesImageMetadata-102042781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-324a4cc7-8f60-4326-bc48-bd918b77b105 tempest-VolumesImageMetadata-102042781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-324a4cc7-8f60-4326-bc48-bd918b77b105 tempest-VolumesImageMetadata-102042781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:00 devstack sudo[91684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:22:00 devstack sudo[91684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:01 devstack sudo[91682]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eef73e68-9748-4562-b038-8981857770ce" returned: 0 in 0.845s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] Lock "cinder-quobyte-eef73e68-9748-4562-b038-8981857770ce" released by "delete_volume" :: held 2.007s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:01 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] Created reservations ['7f101b9e-0d26-4813-808d-694bc8ed13f3'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:01 devstack cinder-volume[87303]: WARNING cinder.quota [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1083299072 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1083299072, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:22:01 devstack cinder-volume[87303]: WARNING cinder.quota [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1083299072 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1083299072, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:22:01 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] Created reservations ['17025b2c-7e7b-4912-81e9-d6357ac1af7f', '3f137898-1049-4cfc-a572-bf575bfffea3', 'e4b42a4b-4149-43e9-9e88-5ca34d0b39ec', '8a1220f4-493f-4f08-be5c-d953622eb869'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:01 devstack sudo[91684]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-324a4cc7-8f60-4326-bc48-bd918b77b105 tempest-VolumesImageMetadata-102042781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.906s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:01 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-324a4cc7-8f60-4326-bc48-bd918b77b105 tempest-VolumesImageMetadata-102042781 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:22:01 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-324a4cc7-8f60-4326-bc48-bd918b77b105 tempest-VolumesImageMetadata-102042781 None] Deleted volume successfully. Jul 07 17:22:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-324a4cc7-8f60-4326-bc48-bd918b77b105 tempest-VolumesImageMetadata-102042781 None] Lock "cinder-38cfdd94-98be-45e9-8ee7-6e9d4bf0b078-delete_volume" released by "delete_volume" :: held 5.402s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:01 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] Created reservations ['5a23960c-e624-43b4-a1da-86f40698b10e', 'f0d0b533-690e-440c-a972-047187ff3398', '122dddfd-722e-453f-94e7-24a8c12f6643', '1356d56e-c8a5-46cf-92af-bc0718a78871'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:01 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:22:01 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:02 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.933s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:02 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:22:02 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-50bc2f60-3b32-4d3b-b401-055402f98e25 tempest-GroupsTest-2093467214 None] Delete group completed successfully. Jul 07 17:22:04 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=78,cinder:INSERT=27,cinder:UPDATE=83,cinder:DELETE=5 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:22:04 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:22:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Flow 'volume_create_manager' (02e6d110-1457-4d24-b59d-b2cef559ea61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968333b0-cb30-4dce-a924-e17422a59d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968333b0-cb30-4dce-a924-e17422a59d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-240797713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683d0b57-496d-4193-bf08-0c324ad5207a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6704c923f70041ffb72101bb36b5d69c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:04Z,use_quota=True,user_id='197ec6ca827145e68eda7d3c345470bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984f4eee-c3ae-44b7-b63e-433016b38f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984f4eee-c3ae-44b7-b63e-433016b38f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f8836c-cbce-4acc-964d-a74dce9b6b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f8836c-cbce-4acc-964d-a74dce9b6b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '683d0b57-496d-4193-bf08-0c324ad5207a', 'volume_name': 'volume-683d0b57-496d-4193-bf08-0c324ad5207a', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ae6a24-432e-4878-b234-a7a20c7bc8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ae6a24-432e-4878-b234-a7a20c7bc8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a03d907-e164-4ee0-8ed9-729d3317490b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:04 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Volume 683d0b57-496d-4193-bf08-0c324ad5207a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-683d0b57-496d-4193-bf08-0c324ad5207a', 'volume_size': 1} Jul 07 17:22:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-240797713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683d0b57-496d-4193-bf08-0c324ad5207a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6704c923f70041ffb72101bb36b5d69c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:04Z,use_quota=True,user_id='197ec6ca827145e68eda7d3c345470bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:22:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Creating volume 683d0b57-496d-4193-bf08-0c324ad5207a {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:22:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:22:04 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:22:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-683d0b57-496d-4193-bf08-0c324ad5207a 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:04 devstack sudo[91695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-683d0b57-496d-4193-bf08-0c324ad5207a 1073741824 Jul 07 17:22:04 devstack sudo[91695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:05 devstack sudo[91695]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-683d0b57-496d-4193-bf08-0c324ad5207a 1073741824" returned: 0 in 1.492s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:05 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:UPDATE=88,cinder:SELECT=78,cinder:INSERT=23,cinder:DELETE=4 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:22:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-683d0b57-496d-4193-bf08-0c324ad5207a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:06 devstack sudo[91706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-683d0b57-496d-4193-bf08-0c324ad5207a Jul 07 17:22:06 devstack sudo[91706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:06 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:22:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Flow 'volume_create_manager' (77fafdba-2072-4247-969f-d7be1b515139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b6bd23-b4d1-42c8-b2b6-6259501da08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b6bd23-b4d1-42c8-b2b6-6259501da08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2144796842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f8ce78-9f82-4a6c-999d-2140d41fbf9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48544ec699c64c7a804e5a76b4638d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:06Z,use_quota=True,user_id='b7b559ffd7034d97b2358143edfa294b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6339534e-bd98-4068-a273-640cd5b3ddf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6339534e-bd98-4068-a273-640cd5b3ddf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24a354b-2b07-435a-865a-d9c3a9719586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24a354b-2b07-435a-865a-d9c3a9719586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0f8ce78-9f82-4a6c-999d-2140d41fbf9e', 'volume_name': 'volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081b0cf8-703f-41af-904c-e415a493a476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081b0cf8-703f-41af-904c-e415a493a476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c932a65-3541-4637-b6be-29324f0c743f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:06 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Volume b0f8ce78-9f82-4a6c-999d-2140d41fbf9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e', 'volume_size': 1} Jul 07 17:22:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:07 devstack sudo[91706]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-683d0b57-496d-4193-bf08-0c324ad5207a" returned: 0 in 1.505s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] <== create_volume: return (3136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:22:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.142s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.846s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2144796842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f8ce78-9f82-4a6c-999d-2140d41fbf9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48544ec699c64c7a804e5a76b4638d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:06Z,use_quota=True,user_id='b7b559ffd7034d97b2358143edfa294b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:22:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Creating volume b0f8ce78-9f82-4a6c-999d-2140d41fbf9e {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:22:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:22:07 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:22:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a03d907-e164-4ee0-8ed9-729d3317490b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-683d0b57-496d-4193-bf08-0c324ad5207a', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66f2a089-97a3-457a-ade9-ecc8968dbc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:07 devstack sudo[91721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e 1073741824 Jul 07 17:22:07 devstack sudo[91721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:07 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Volume volume-683d0b57-496d-4193-bf08-0c324ad5207a (683d0b57-496d-4193-bf08-0c324ad5207a): created successfully Jul 07 17:22:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66f2a089-97a3-457a-ade9-ecc8968dbc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Flow 'volume_create_manager' (02e6d110-1457-4d24-b59d-b2cef559ea61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:07 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-7f624c68-5249-402b-b29d-80471607e288 tempest-ServerActionsTestOtherA-1941139839 None] Created volume successfully. Jul 07 17:22:09 devstack sudo[91721]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e 1073741824" returned: 0 in 1.526s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:09 devstack sudo[91727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e Jul 07 17:22:09 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:10 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e" returned: 0 in 1.085s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] <== create_volume: return (2671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:22:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.680s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c932a65-3541-4637-b6be-29324f0c743f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9305f0a8-a6aa-4cc2-aaf9-c7fad67c813a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:10 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Volume volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e (b0f8ce78-9f82-4a6c-999d-2140d41fbf9e): created successfully Jul 07 17:22:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9305f0a8-a6aa-4cc2-aaf9-c7fad67c813a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Flow 'volume_create_manager' (77fafdba-2072-4247-969f-d7be1b515139) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:10 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-49956252-4b65-43b8-a495-d5418d81d788 tempest-VolumesDeleteCascade-1596305227 None] Created volume successfully. Jul 07 17:22:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3de36dbd-4614-465e-8c3a-ca63e62b1f6d tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3de36dbd-4614-465e-8c3a-ca63e62b1f6d tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-3de36dbd-4614-465e-8c3a-ca63e62b1f6d tempest-VolumesDeleteCascade-1596305227 None] Creating offline snapshot e605562e-5147-49fc-86f3-bde3accc1e40 of volume b0f8ce78-9f82-4a6c-999d-2140d41fbf9e {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:22:11 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a854ded-016a-4608-96e6-cd22723fe0fc]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3de36dbd-4614-465e-8c3a-ca63e62b1f6d tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:11 devstack sudo[91768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e Jul 07 17:22:11 devstack sudo[91768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:11 devstack sudo[91768]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3de36dbd-4614-465e-8c3a-ca63e62b1f6d tempest-VolumesDeleteCascade-1596305227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e" returned: 0 in 0.845s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3de36dbd-4614-465e-8c3a-ca63e62b1f6d tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:11 devstack sudo[91774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40 1G Jul 07 17:22:11 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:11 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:22:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Flow 'volume_create_manager' (c220d334-b62f-4cbf-86ba-ee85ed1e1e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f32edb3-5151-4f14-9d80-892af472d9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f32edb3-5151-4f14-9d80-892af472d9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1464843953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d52b2f3-cba6-4075-bdbf-85b6b66f0264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c9261d64ee41599fa502bed4ffdcfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:12Z,use_quota=True,user_id='c9358f09d88b49b097c0bb3c9194146d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6a2ba7-1765-4c46-9ecb-1e81131e2152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6a2ba7-1765-4c46-9ecb-1e81131e2152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b2cfe2-dc6a-41da-ba29-a50a5a780c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b2cfe2-dc6a-41da-ba29-a50a5a780c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d52b2f3-cba6-4075-bdbf-85b6b66f0264', 'volume_name': 'volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57dc569-fdc8-4f5d-89e2-b480729d84a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57dc569-fdc8-4f5d-89e2-b480729d84a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7037ec7b-e22c-41ab-b98a-ac6805bc3ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:12 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Volume 1d52b2f3-cba6-4075-bdbf-85b6b66f0264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264', 'volume_size': 1} Jul 07 17:22:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:12 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3de36dbd-4614-465e-8c3a-ca63e62b1f6d tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40 1G" returned: 0 in 0.838s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3de36dbd-4614-465e-8c3a-ca63e62b1f6d tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:12 devstack sudo[91780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40 Jul 07 17:22:12 devstack sudo[91780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:13 devstack sudo[91780]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3de36dbd-4614-465e-8c3a-ca63e62b1f6d tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40" returned: 0 in 0.735s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:13 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-3de36dbd-4614-465e-8c3a-ca63e62b1f6d tempest-VolumesDeleteCascade-1596305227 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40 is being set with open permissions: ugo+rw Jul 07 17:22:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3de36dbd-4614-465e-8c3a-ca63e62b1f6d tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:13 devstack sudo[91786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40 Jul 07 17:22:13 devstack sudo[91786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:14 devstack sudo[91786]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3de36dbd-4614-465e-8c3a-ca63e62b1f6d tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40" returned: 0 in 0.680s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3de36dbd-4614-465e-8c3a-ca63e62b1f6d tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:14 devstack sudo[91789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.info Jul 07 17:22:14 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:14 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3de36dbd-4614-465e-8c3a-ca63e62b1f6d tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.info" returned: 0 in 0.674s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:14 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-3de36dbd-4614-465e-8c3a-ca63e62b1f6d tempest-VolumesDeleteCascade-1596305227 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.info is being set with open permissions: ugo+rw Jul 07 17:22:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3de36dbd-4614-465e-8c3a-ca63e62b1f6d tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:14 devstack sudo[91792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.info Jul 07 17:22:14 devstack sudo[91792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:15 devstack sudo[91792]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3de36dbd-4614-465e-8c3a-ca63e62b1f6d tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.info" returned: 0 in 0.798s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3de36dbd-4614-465e-8c3a-ca63e62b1f6d tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.673s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.656s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1464843953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d52b2f3-cba6-4075-bdbf-85b6b66f0264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c9261d64ee41599fa502bed4ffdcfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:12Z,use_quota=True,user_id='c9358f09d88b49b097c0bb3c9194146d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:22:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Creating volume 1d52b2f3-cba6-4075-bdbf-85b6b66f0264 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:22:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:22:15 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:22:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:15 devstack sudo[91795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264 1073741824 Jul 07 17:22:15 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:15 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-3de36dbd-4614-465e-8c3a-ca63e62b1f6d tempest-VolumesDeleteCascade-1596305227 None] Create snapshot completed successfully Jul 07 17:22:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-59f2e3aa-e75e-4736-86c0-fe8cd9e6aadd tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:16 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264 1073741824" returned: 0 in 1.190s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:16 devstack sudo[91814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264 Jul 07 17:22:16 devstack sudo[91814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:17 devstack sudo[91814]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264" returned: 0 in 0.730s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] <== create_volume: return (1988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:22:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-59f2e3aa-e75e-4736-86c0-fe8cd9e6aadd tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.115s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-59f2e3aa-e75e-4736-86c0-fe8cd9e6aadd tempest-VolumesDeleteCascade-1596305227 None] Creating offline snapshot 4bf36d18-8cf8-489f-bbcd-de6235ac0746 of volume b0f8ce78-9f82-4a6c-999d-2140d41fbf9e {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:22:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7037ec7b-e22c-41ab-b98a-ac6805bc3ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57dfe633-9be6-4ca7-a4e7-6e03bec09917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:17 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26356e3-63b0-44ce-9dca-ab77ccec5217]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-59f2e3aa-e75e-4736-86c0-fe8cd9e6aadd tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:17 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Volume volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264 (1d52b2f3-cba6-4075-bdbf-85b6b66f0264): created successfully Jul 07 17:22:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57dfe633-9be6-4ca7-a4e7-6e03bec09917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Flow 'volume_create_manager' (c220d334-b62f-4cbf-86ba-ee85ed1e1e54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:17 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b5c68d29-4395-4a2e-85d8-6d0e5d84f887 tempest-SnapshotsActionsTest-529068948 None] Created volume successfully. Jul 07 17:22:17 devstack sudo[91822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40 Jul 07 17:22:17 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7b7204a5-51aa-4ccf-b9a2-6568e0cef7f2 tempest-SnapshotsActionsTest-529068948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:18 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-59f2e3aa-e75e-4736-86c0-fe8cd9e6aadd tempest-VolumesDeleteCascade-1596305227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40" returned: 0 in 0.975s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:18 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-59f2e3aa-e75e-4736-86c0-fe8cd9e6aadd tempest-VolumesDeleteCascade-1596305227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:22:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-59f2e3aa-e75e-4736-86c0-fe8cd9e6aadd tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.4bf36d18-8cf8-489f-bbcd-de6235ac0746 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:18 devstack sudo[91827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.4bf36d18-8cf8-489f-bbcd-de6235ac0746 1G Jul 07 17:22:18 devstack sudo[91827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:19 devstack sudo[91827]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-59f2e3aa-e75e-4736-86c0-fe8cd9e6aadd tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.4bf36d18-8cf8-489f-bbcd-de6235ac0746 1G" returned: 0 in 0.951s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-59f2e3aa-e75e-4736-86c0-fe8cd9e6aadd tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.4bf36d18-8cf8-489f-bbcd-de6235ac0746 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:19 devstack sudo[91832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.4bf36d18-8cf8-489f-bbcd-de6235ac0746 Jul 07 17:22:19 devstack sudo[91832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:20 devstack sudo[91832]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-59f2e3aa-e75e-4736-86c0-fe8cd9e6aadd tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.4bf36d18-8cf8-489f-bbcd-de6235ac0746" returned: 0 in 0.768s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:20 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-59f2e3aa-e75e-4736-86c0-fe8cd9e6aadd tempest-VolumesDeleteCascade-1596305227 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.4bf36d18-8cf8-489f-bbcd-de6235ac0746 is being set with open permissions: ugo+rw Jul 07 17:22:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-59f2e3aa-e75e-4736-86c0-fe8cd9e6aadd tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.4bf36d18-8cf8-489f-bbcd-de6235ac0746 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:20 devstack sudo[91840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.4bf36d18-8cf8-489f-bbcd-de6235ac0746 Jul 07 17:22:20 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:21 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:22:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Flow 'volume_create_manager' (de8abef7-6492-4192-ace0-b0aca6a60701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b042b7-4b3a-456a-8bf1-ebc2ad43403a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b042b7-4b3a-456a-8bf1-ebc2ad43403a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-667839712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b28e4c-0c3a-45b1-995e-59b1843cb329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='446e81ef1cc84a43a46e6879cee1f7ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:21Z,use_quota=True,user_id='7ae422fed39940ddaaa0decdc98fe50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ce2992-7ba9-4566-8d54-b1a4532e8b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ce2992-7ba9-4566-8d54-b1a4532e8b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84712eaf-366a-45a1-a967-a34d5bc47ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84712eaf-366a-45a1-a967-a34d5bc47ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25b28e4c-0c3a-45b1-995e-59b1843cb329', 'volume_name': 'volume-25b28e4c-0c3a-45b1-995e-59b1843cb329', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61eda0ba-0365-49b2-8136-3b10ff2852e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61eda0ba-0365-49b2-8136-3b10ff2852e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87700186-5176-4a23-9175-04dbc4fcf493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:21 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Volume 25b28e4c-0c3a-45b1-995e-59b1843cb329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25b28e4c-0c3a-45b1-995e-59b1843cb329', 'volume_size': 1} Jul 07 17:22:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:21 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-59f2e3aa-e75e-4736-86c0-fe8cd9e6aadd tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.4bf36d18-8cf8-489f-bbcd-de6235ac0746" returned: 0 in 1.145s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-59f2e3aa-e75e-4736-86c0-fe8cd9e6aadd tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.965s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7b7204a5-51aa-4ccf-b9a2-6568e0cef7f2 tempest-SnapshotsActionsTest-529068948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.982s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-7b7204a5-51aa-4ccf-b9a2-6568e0cef7f2 tempest-SnapshotsActionsTest-529068948 None] Creating offline snapshot d0b18aa5-2fb1-4216-9a35-9f26648907b7 of volume 1d52b2f3-cba6-4075-bdbf-85b6b66f0264 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:22:21 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa51efd-df32-4b9c-8f41-2ae3c551fd2b]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7b7204a5-51aa-4ccf-b9a2-6568e0cef7f2 tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:21 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-59f2e3aa-e75e-4736-86c0-fe8cd9e6aadd tempest-VolumesDeleteCascade-1596305227 None] Create snapshot completed successfully Jul 07 17:22:21 devstack sudo[91864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264 Jul 07 17:22:21 devstack sudo[91864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "cinder-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Performing cascade delete. {{(pid=87303) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 17:22:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "cinder-4bf36d18-8cf8-489f-bbcd-de6235ac0746-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-4bf36d18-8cf8-489f-bbcd-de6235ac0746-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:22 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "cinder-quobyte-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:22 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-quobyte-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:22 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "cinder-quobyte-4bf36d18-8cf8-489f-bbcd-de6235ac0746" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:22 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-quobyte-4bf36d18-8cf8-489f-bbcd-de6235ac0746" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Deleting offline snapshot 4bf36d18-8cf8-489f-bbcd-de6235ac0746 of volume b0f8ce78-9f82-4a6c-999d-2140d41fbf9e {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:22:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] snapshot_file for this snap is: volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.4bf36d18-8cf8-489f-bbcd-de6235ac0746 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:22:22 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[819da5ce-836a-4176-8db2-12127258216e]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.4bf36d18-8cf8-489f-bbcd-de6235ac0746 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:22 devstack sudo[91866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.4bf36d18-8cf8-489f-bbcd-de6235ac0746 Jul 07 17:22:22 devstack sudo[91866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:22 devstack sudo[91864]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7b7204a5-51aa-4ccf-b9a2-6568e0cef7f2 tempest-SnapshotsActionsTest-529068948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264" returned: 0 in 0.953s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7b7204a5-51aa-4ccf-b9a2-6568e0cef7f2 tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:22 devstack sudo[91890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 1G Jul 07 17:22:22 devstack sudo[91890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:22 devstack sudo[91866]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.4bf36d18-8cf8-489f-bbcd-de6235ac0746" returned: 0 in 0.880s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:22:23 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[7585b783-802f-43bb-ac2f-86b208e4a101]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:23 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40 Jul 07 17:22:23 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:23 devstack sudo[91890]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7b7204a5-51aa-4ccf-b9a2-6568e0cef7f2 tempest-SnapshotsActionsTest-529068948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 1G" returned: 0 in 1.042s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7b7204a5-51aa-4ccf-b9a2-6568e0cef7f2 tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:23 devstack sudo[91902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 Jul 07 17:22:23 devstack sudo[91902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:24 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40" returned: 0 in 1.079s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:24 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:22:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.4bf36d18-8cf8-489f-bbcd-de6235ac0746 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:24 devstack sudo[91907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.4bf36d18-8cf8-489f-bbcd-de6235ac0746 Jul 07 17:22:24 devstack sudo[91907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:24 devstack sudo[91902]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7b7204a5-51aa-4ccf-b9a2-6568e0cef7f2 tempest-SnapshotsActionsTest-529068948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7" returned: 0 in 0.957s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:24 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-7b7204a5-51aa-4ccf-b9a2-6568e0cef7f2 tempest-SnapshotsActionsTest-529068948 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 is being set with open permissions: ugo+rw Jul 07 17:22:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7b7204a5-51aa-4ccf-b9a2-6568e0cef7f2 tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:24 devstack sudo[91913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 Jul 07 17:22:24 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:25 devstack sudo[91907]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.4bf36d18-8cf8-489f-bbcd-de6235ac0746" returned: 0 in 1.129s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.4bf36d18-8cf8-489f-bbcd-de6235ac0746 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:25 devstack sudo[91920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.4bf36d18-8cf8-489f-bbcd-de6235ac0746 Jul 07 17:22:25 devstack sudo[91920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:25 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7b7204a5-51aa-4ccf-b9a2-6568e0cef7f2 tempest-SnapshotsActionsTest-529068948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7" returned: 0 in 0.922s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7b7204a5-51aa-4ccf-b9a2-6568e0cef7f2 tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:25 devstack sudo[91923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.info Jul 07 17:22:25 devstack sudo[91923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:26 devstack sudo[91920]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.4bf36d18-8cf8-489f-bbcd-de6235ac0746" returned: 0 in 0.811s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-quobyte-4bf36d18-8cf8-489f-bbcd-de6235ac0746" released by "_delete_snapshot" :: held 4.059s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-quobyte-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e" released by "delete_snapshot" :: held 4.092s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:26 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Created reservations ['9589effe-9aa0-44dd-970a-3dc3ef5f791f', 'a08c106a-2786-4d2d-a1c8-9882d0f9055a', '42ee9221-c17c-49b9-a100-b0b939ca45b1', '3be9ff95-6533-4851-9f27-cd69217c0368'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:26 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Delete snapshot completed successfully. Jul 07 17:22:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-4bf36d18-8cf8-489f-bbcd-de6235ac0746-delete_snapshot" released by "delete_snapshot" :: held 4.417s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "cinder-e605562e-5147-49fc-86f3-bde3accc1e40-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-e605562e-5147-49fc-86f3-bde3accc1e40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "cinder-quobyte-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:26 devstack sudo[91923]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7b7204a5-51aa-4ccf-b9a2-6568e0cef7f2 tempest-SnapshotsActionsTest-529068948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.info" returned: 0 in 0.848s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:26 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-7b7204a5-51aa-4ccf-b9a2-6568e0cef7f2 tempest-SnapshotsActionsTest-529068948 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.info is being set with open permissions: ugo+rw Jul 07 17:22:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7b7204a5-51aa-4ccf-b9a2-6568e0cef7f2 tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-quobyte-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "cinder-quobyte-e605562e-5147-49fc-86f3-bde3accc1e40" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-quobyte-e605562e-5147-49fc-86f3-bde3accc1e40" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:26 devstack sudo[91927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.info Jul 07 17:22:26 devstack sudo[91927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:26 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Deleting offline snapshot e605562e-5147-49fc-86f3-bde3accc1e40 of volume b0f8ce78-9f82-4a6c-999d-2140d41fbf9e {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:22:26 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] snapshot_file for this snap is: volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:22:26 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[981445f5-4d60-4d25-bcb1-bfa0904b8966]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:26 devstack sudo[91929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40 Jul 07 17:22:26 devstack sudo[91929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:27 devstack sudo[91927]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7b7204a5-51aa-4ccf-b9a2-6568e0cef7f2 tempest-SnapshotsActionsTest-529068948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.info" returned: 0 in 0.925s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7b7204a5-51aa-4ccf-b9a2-6568e0cef7f2 tempest-SnapshotsActionsTest-529068948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.799s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.273s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-667839712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b28e4c-0c3a-45b1-995e-59b1843cb329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='446e81ef1cc84a43a46e6879cee1f7ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:21Z,use_quota=True,user_id='7ae422fed39940ddaaa0decdc98fe50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:22:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Creating volume 25b28e4c-0c3a-45b1-995e-59b1843cb329 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:22:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:22:27 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:22:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-25b28e4c-0c3a-45b1-995e-59b1843cb329 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:27 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-7b7204a5-51aa-4ccf-b9a2-6568e0cef7f2 tempest-SnapshotsActionsTest-529068948 None] Create snapshot completed successfully Jul 07 17:22:27 devstack sudo[91934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-25b28e4c-0c3a-45b1-995e-59b1843cb329 1073741824 Jul 07 17:22:27 devstack sudo[91934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:27 devstack sudo[91929]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40" returned: 0 in 1.129s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:22:27 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4c3325-614a-456c-a345-4358efa0da8a]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:27 devstack sudo[91939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e Jul 07 17:22:27 devstack sudo[91939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:28 devstack sudo[91934]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-25b28e4c-0c3a-45b1-995e-59b1843cb329 1073741824" returned: 0 in 1.166s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-25b28e4c-0c3a-45b1-995e-59b1843cb329 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:28 devstack sudo[91946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-25b28e4c-0c3a-45b1-995e-59b1843cb329 Jul 07 17:22:28 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:28 devstack sudo[91939]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e" returned: 0 in 1.201s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:29 devstack sudo[91949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40 Jul 07 17:22:29 devstack sudo[91949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dce0e402-8245-4303-b401-234a8a6fb0a7 tempest-SnapshotsActionsTest-529068948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:29 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-25b28e4c-0c3a-45b1-995e-59b1843cb329" returned: 0 in 0.715s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:22:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dce0e402-8245-4303-b401-234a8a6fb0a7 tempest-SnapshotsActionsTest-529068948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.327s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87700186-5176-4a23-9175-04dbc4fcf493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b28e4c-0c3a-45b1-995e-59b1843cb329', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ade2de-2319-4799-a0ee-7414f8f7f46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-dce0e402-8245-4303-b401-234a8a6fb0a7 tempest-SnapshotsActionsTest-529068948 None] Creating offline snapshot a0fea9e4-1ddd-4cf9-8556-535a5b699872 of volume 1d52b2f3-cba6-4075-bdbf-85b6b66f0264 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:22:29 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Volume volume-25b28e4c-0c3a-45b1-995e-59b1843cb329 (25b28e4c-0c3a-45b1-995e-59b1843cb329): created successfully Jul 07 17:22:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ade2de-2319-4799-a0ee-7414f8f7f46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Flow 'volume_create_manager' (de8abef7-6492-4192-ace0-b0aca6a60701) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:29 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[801104b8-a7c6-46c2-bde7-622de308e31d]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dce0e402-8245-4303-b401-234a8a6fb0a7 tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:29 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-56e4ed1d-54f8-4ef9-aa0f-f3bcc825560a tempest-AttachVolumeTestJSON-285176547 None] Created volume successfully. Jul 07 17:22:29 devstack sudo[91952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 Jul 07 17:22:29 devstack sudo[91952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:29 devstack sudo[91949]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40" returned: 0 in 1.015s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:30 devstack sudo[91957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40 Jul 07 17:22:30 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:30 devstack sudo[91952]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dce0e402-8245-4303-b401-234a8a6fb0a7 tempest-SnapshotsActionsTest-529068948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7" returned: 0 in 1.007s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-dce0e402-8245-4303-b401-234a8a6fb0a7 tempest-SnapshotsActionsTest-529068948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:22:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dce0e402-8245-4303-b401-234a8a6fb0a7 tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.a0fea9e4-1ddd-4cf9-8556-535a5b699872 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:30 devstack sudo[91969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.a0fea9e4-1ddd-4cf9-8556-535a5b699872 1G Jul 07 17:22:30 devstack sudo[91969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:30 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e.e605562e-5147-49fc-86f3-bde3accc1e40" returned: 0 in 0.716s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-quobyte-e605562e-5147-49fc-86f3-bde3accc1e40" released by "_delete_snapshot" :: held 4.174s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-quobyte-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e" released by "delete_snapshot" :: held 4.205s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:30 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Created reservations ['8117b8b8-faa8-4aa2-959b-1394b8177de7', '81c9de9e-38cf-4c8c-a4d9-a0b5232dad1c', '61861829-b700-4dd5-946e-5908081cb083', 'f335d539-4ec1-4c18-b37e-dcd99a7397a3'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:30 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Delete snapshot completed successfully. Jul 07 17:22:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-e605562e-5147-49fc-86f3-bde3accc1e40-delete_snapshot" released by "delete_snapshot" :: held 4.434s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Snapshots deleted, issuing volume delete {{(pid=87303) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 17:22:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "cinder-quobyte-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-quobyte-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e" acquired by "delete_volume" :: waited 0.016s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:30 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[9517cdb0-e516-4b0d-a4f1-09f00fddeead]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:31 devstack sudo[91971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e Jul 07 17:22:31 devstack sudo[91971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:31 devstack sudo[91969]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dce0e402-8245-4303-b401-234a8a6fb0a7 tempest-SnapshotsActionsTest-529068948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.a0fea9e4-1ddd-4cf9-8556-535a5b699872 1G" returned: 0 in 0.927s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dce0e402-8245-4303-b401-234a8a6fb0a7 tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.a0fea9e4-1ddd-4cf9-8556-535a5b699872 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:31 devstack sudo[91976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.a0fea9e4-1ddd-4cf9-8556-535a5b699872 Jul 07 17:22:31 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:31 devstack sudo[91971]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e" returned: 0 in 0.784s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:31 devstack sudo[91981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e Jul 07 17:22:31 devstack sudo[91981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:32 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dce0e402-8245-4303-b401-234a8a6fb0a7 tempest-SnapshotsActionsTest-529068948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.a0fea9e4-1ddd-4cf9-8556-535a5b699872" returned: 0 in 0.815s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:32 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-dce0e402-8245-4303-b401-234a8a6fb0a7 tempest-SnapshotsActionsTest-529068948 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.a0fea9e4-1ddd-4cf9-8556-535a5b699872 is being set with open permissions: ugo+rw Jul 07 17:22:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dce0e402-8245-4303-b401-234a8a6fb0a7 tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.a0fea9e4-1ddd-4cf9-8556-535a5b699872 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:32 devstack sudo[91987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.a0fea9e4-1ddd-4cf9-8556-535a5b699872 Jul 07 17:22:32 devstack sudo[91987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:32 devstack sudo[91981]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e" returned: 0 in 0.745s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:32 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-quobyte-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e" released by "delete_volume" :: held 1.604s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:32 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Created reservations ['2eb09db9-6f8f-4a55-a408-2ed43bd7bfa3', '80f1632d-0951-4ce5-8122-9dca37816407', 'b1f443af-aa14-43f7-ab0f-df4e5df90ddb', 'ff955812-e2a4-4f88-a51f-f9a7f3e296c2'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:32 devstack sudo[91990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:22:32 devstack sudo[91990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:33 devstack sudo[91987]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dce0e402-8245-4303-b401-234a8a6fb0a7 tempest-SnapshotsActionsTest-529068948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.a0fea9e4-1ddd-4cf9-8556-535a5b699872" returned: 0 in 0.763s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dce0e402-8245-4303-b401-234a8a6fb0a7 tempest-SnapshotsActionsTest-529068948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.687s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:33 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-dce0e402-8245-4303-b401-234a8a6fb0a7 tempest-SnapshotsActionsTest-529068948 None] Create snapshot completed successfully Jul 07 17:22:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-d2fc57f2-380c-44a8-a30a-52c92c27a797 req-9c9bbb11-8817-40c6-8472-8a61abb1cd54 tempest-AttachVolumeTestJSON-285176547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-d2fc57f2-380c-44a8-a30a-52c92c27a797 req-9c9bbb11-8817-40c6-8472-8a61abb1cd54 tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:33 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9c26e2-b0ae-4d8d-b0bd-aaee1bbc0b32]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-d2fc57f2-380c-44a8-a30a-52c92c27a797 req-9c9bbb11-8817-40c6-8472-8a61abb1cd54 tempest-AttachVolumeTestJSON-285176547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-25b28e4c-0c3a-45b1-995e-59b1843cb329 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:33 devstack sudo[92001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-25b28e4c-0c3a-45b1-995e-59b1843cb329 Jul 07 17:22:33 devstack sudo[92001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:33 devstack sudo[91990]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.914s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:33 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:22:33 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Deleted volume successfully. Jul 07 17:22:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-83b79890-1b5d-4bba-a91a-ec1c9ecfea1f tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-b0f8ce78-9f82-4a6c-999d-2140d41fbf9e-delete_volume" released by "delete_volume" :: held 11.714s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8c55b050-92c1-4851-b6d1-ebc89ce9d957 tempest-SnapshotsActionsTest-286588036 None] Acquiring lock "cinder-a0fea9e4-1ddd-4cf9-8556-535a5b699872-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8c55b050-92c1-4851-b6d1-ebc89ce9d957 tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-a0fea9e4-1ddd-4cf9-8556-535a5b699872-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8c55b050-92c1-4851-b6d1-ebc89ce9d957 tempest-SnapshotsActionsTest-286588036 None] Acquiring lock "cinder-quobyte-1d52b2f3-cba6-4075-bdbf-85b6b66f0264" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8c55b050-92c1-4851-b6d1-ebc89ce9d957 tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-quobyte-1d52b2f3-cba6-4075-bdbf-85b6b66f0264" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8c55b050-92c1-4851-b6d1-ebc89ce9d957 tempest-SnapshotsActionsTest-286588036 None] Acquiring lock "cinder-quobyte-a0fea9e4-1ddd-4cf9-8556-535a5b699872" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8c55b050-92c1-4851-b6d1-ebc89ce9d957 tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-quobyte-a0fea9e4-1ddd-4cf9-8556-535a5b699872" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-8c55b050-92c1-4851-b6d1-ebc89ce9d957 tempest-SnapshotsActionsTest-286588036 None] Deleting offline snapshot a0fea9e4-1ddd-4cf9-8556-535a5b699872 of volume 1d52b2f3-cba6-4075-bdbf-85b6b66f0264 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-8c55b050-92c1-4851-b6d1-ebc89ce9d957 tempest-SnapshotsActionsTest-286588036 None] snapshot_file for this snap is: volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.a0fea9e4-1ddd-4cf9-8556-535a5b699872 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[4232260d-1733-4c9f-9be6-eab45e36e864]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8c55b050-92c1-4851-b6d1-ebc89ce9d957 tempest-SnapshotsActionsTest-286588036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.a0fea9e4-1ddd-4cf9-8556-535a5b699872 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Flow 'volume_create_manager' (c22ea44e-ff63-4eb2-9699-80f82599d92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ef869a-3561-4745-aee6-1ec735073d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ef869a-3561-4745-aee6-1ec735073d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1359894721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaccecb9-9fa6-4b13-bf11-84e9dde91c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48544ec699c64c7a804e5a76b4638d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:34Z,use_quota=True,user_id='b7b559ffd7034d97b2358143edfa294b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:34 devstack sudo[92001]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088146d3-d1ad-4907-98eb-d4f1f155bd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088146d3-d1ad-4907-98eb-d4f1f155bd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16471937-2774-4640-9844-a7f4a85d1ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:34 devstack sudo[92007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.a0fea9e4-1ddd-4cf9-8556-535a5b699872 Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16471937-2774-4640-9844-a7f4a85d1ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaccecb9-9fa6-4b13-bf11-84e9dde91c22', 'volume_name': 'volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:34 devstack sudo[92007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905c088e-54c3-4a4e-851b-62de1af6f55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905c088e-54c3-4a4e-851b-62de1af6f55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe02d91-e663-443c-ba90-854126820db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:34 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Volume eaccecb9-9fa6-4b13-bf11-84e9dde91c22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22', 'volume_size': 1} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-d2fc57f2-380c-44a8-a30a-52c92c27a797 req-9c9bbb11-8817-40c6-8472-8a61abb1cd54 tempest-AttachVolumeTestJSON-285176547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-25b28e4c-0c3a-45b1-995e-59b1843cb329" returned: 0 in 1.078s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-d2fc57f2-380c-44a8-a30a-52c92c27a797 req-9c9bbb11-8817-40c6-8472-8a61abb1cd54 tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.100s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1359894721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaccecb9-9fa6-4b13-bf11-84e9dde91c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48544ec699c64c7a804e5a76b4638d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:34Z,use_quota=True,user_id='b7b559ffd7034d97b2358143edfa294b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Creating volume eaccecb9-9fa6-4b13-bf11-84e9dde91c22 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:22:34 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:34 devstack sudo[92009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 1073741824 Jul 07 17:22:34 devstack sudo[92009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-d2fc57f2-380c-44a8-a30a-52c92c27a797 req-9c9bbb11-8817-40c6-8472-8a61abb1cd54 tempest-AttachVolumeTestJSON-285176547 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2', 'name': 'volume-25b28e4c-0c3a-45b1-995e-59b1843cb329', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44a2833c-f97c-4202-a649-5e7c27b75c4b', 'enforce_multipath': True} {{(pid=87303) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:22:34 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-d2fc57f2-380c-44a8-a30a-52c92c27a797 req-9c9bbb11-8817-40c6-8472-8a61abb1cd54 tempest-AttachVolumeTestJSON-285176547 None] attachment_update completed successfully. Jul 07 17:22:35 devstack sudo[92007]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8c55b050-92c1-4851-b6d1-ebc89ce9d957 tempest-SnapshotsActionsTest-286588036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.a0fea9e4-1ddd-4cf9-8556-535a5b699872" returned: 0 in 1.000s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:35 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-8c55b050-92c1-4851-b6d1-ebc89ce9d957 tempest-SnapshotsActionsTest-286588036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:22:35 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff152c8-b9da-43c8-828d-79472fc4f614]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8c55b050-92c1-4851-b6d1-ebc89ce9d957 tempest-SnapshotsActionsTest-286588036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:35 devstack sudo[92086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 Jul 07 17:22:35 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:35 devstack sudo[92009]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 1073741824" returned: 0 in 1.043s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:35 devstack sudo[92088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 Jul 07 17:22:35 devstack sudo[92088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:36 devstack sudo[92088]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22" returned: 0 in 0.790s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:22:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe02d91-e663-443c-ba90-854126820db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69daf5af-754e-43c1-ad69-0ec37b7b1dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:36 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Volume volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 (eaccecb9-9fa6-4b13-bf11-84e9dde91c22): created successfully Jul 07 17:22:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69daf5af-754e-43c1-ad69-0ec37b7b1dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Flow 'volume_create_manager' (c22ea44e-ff63-4eb2-9699-80f82599d92a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:36 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8c55b050-92c1-4851-b6d1-ebc89ce9d957 tempest-SnapshotsActionsTest-286588036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7" returned: 0 in 1.087s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-8c55b050-92c1-4851-b6d1-ebc89ce9d957 tempest-SnapshotsActionsTest-286588036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:22:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8c55b050-92c1-4851-b6d1-ebc89ce9d957 tempest-SnapshotsActionsTest-286588036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.a0fea9e4-1ddd-4cf9-8556-535a5b699872 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:36 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-46e75a2c-7d1e-4bf0-9f83-f7fe3645b8a4 tempest-VolumesDeleteCascade-1596305227 None] Created volume successfully. Jul 07 17:22:36 devstack sudo[92411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.a0fea9e4-1ddd-4cf9-8556-535a5b699872 Jul 07 17:22:36 devstack sudo[92411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:37 devstack sudo[92411]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8c55b050-92c1-4851-b6d1-ebc89ce9d957 tempest-SnapshotsActionsTest-286588036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.a0fea9e4-1ddd-4cf9-8556-535a5b699872" returned: 0 in 0.843s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8c55b050-92c1-4851-b6d1-ebc89ce9d957 tempest-SnapshotsActionsTest-286588036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.a0fea9e4-1ddd-4cf9-8556-535a5b699872 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:37 devstack sudo[92453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.a0fea9e4-1ddd-4cf9-8556-535a5b699872 Jul 07 17:22:37 devstack sudo[92453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b13b67b2-6ffa-4577-ab92-8fabfc0ca00d tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b13b67b2-6ffa-4577-ab92-8fabfc0ca00d tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-b13b67b2-6ffa-4577-ab92-8fabfc0ca00d tempest-VolumesDeleteCascade-1596305227 None] Creating offline snapshot d530d11f-7066-4ff9-bc01-e76a546c65ba of volume eaccecb9-9fa6-4b13-bf11-84e9dde91c22 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:22:37 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[e899fd2a-fbf6-419b-818e-9f1a4fb93812]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b13b67b2-6ffa-4577-ab92-8fabfc0ca00d tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:37 devstack sudo[92455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 Jul 07 17:22:37 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:37 devstack sudo[92453]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8c55b050-92c1-4851-b6d1-ebc89ce9d957 tempest-SnapshotsActionsTest-286588036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.a0fea9e4-1ddd-4cf9-8556-535a5b699872" returned: 0 in 0.734s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:38 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8c55b050-92c1-4851-b6d1-ebc89ce9d957 tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-quobyte-a0fea9e4-1ddd-4cf9-8556-535a5b699872" released by "_delete_snapshot" :: held 3.772s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:38 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8c55b050-92c1-4851-b6d1-ebc89ce9d957 tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-quobyte-1d52b2f3-cba6-4075-bdbf-85b6b66f0264" released by "delete_snapshot" :: held 3.820s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:38 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-8c55b050-92c1-4851-b6d1-ebc89ce9d957 tempest-SnapshotsActionsTest-286588036 None] Created reservations ['8659d97f-d6c6-48ef-8b56-cbff2bdc1bf6', '687fc593-a2ac-473d-9580-9207ca591c11', '9cf9ae0e-55f3-4b71-a50a-301ac2fa6f60', '714231a0-6ffa-4891-9557-cb898d5f2175'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:38 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-8c55b050-92c1-4851-b6d1-ebc89ce9d957 tempest-SnapshotsActionsTest-286588036 None] Delete snapshot completed successfully. Jul 07 17:22:38 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8c55b050-92c1-4851-b6d1-ebc89ce9d957 tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-a0fea9e4-1ddd-4cf9-8556-535a5b699872-delete_snapshot" released by "delete_snapshot" :: held 4.009s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:38 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b13b67b2-6ffa-4577-ab92-8fabfc0ca00d tempest-VolumesDeleteCascade-1596305227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22" returned: 0 in 1.090s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b13b67b2-6ffa-4577-ab92-8fabfc0ca00d tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.d530d11f-7066-4ff9-bc01-e76a546c65ba 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:38 devstack sudo[92462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.d530d11f-7066-4ff9-bc01-e76a546c65ba 1G Jul 07 17:22:38 devstack sudo[92462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-40da4039-c660-4908-a77a-dd17da5958da tempest-SnapshotsActionsTest-529068948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:39 devstack sudo[92462]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b13b67b2-6ffa-4577-ab92-8fabfc0ca00d tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.d530d11f-7066-4ff9-bc01-e76a546c65ba 1G" returned: 0 in 1.032s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b13b67b2-6ffa-4577-ab92-8fabfc0ca00d tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.d530d11f-7066-4ff9-bc01-e76a546c65ba {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:39 devstack sudo[92490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.d530d11f-7066-4ff9-bc01-e76a546c65ba Jul 07 17:22:39 devstack sudo[92490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:40 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:22:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Flow 'volume_create_manager' (cfa63574-48d9-4aa5-8272-a49e35f8fc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db0968e-2aae-473b-8b85-eb8f2a88d689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db0968e-2aae-473b-8b85-eb8f2a88d689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1068121679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c0146dd-7357-4309-849b-e3d4858c0123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='446e81ef1cc84a43a46e6879cee1f7ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:40Z,use_quota=True,user_id='7ae422fed39940ddaaa0decdc98fe50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57dc7fd6-3970-48df-a606-841abb407c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57dc7fd6-3970-48df-a606-841abb407c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f32f01a-32d5-44d8-8c44-50db37f8cd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f32f01a-32d5-44d8-8c44-50db37f8cd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c0146dd-7357-4309-849b-e3d4858c0123', 'volume_name': 'volume-9c0146dd-7357-4309-849b-e3d4858c0123', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d7aad2-2ac4-4886-bbbe-6b32a224ceac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d7aad2-2ac4-4886-bbbe-6b32a224ceac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02492b2-aa84-425f-841d-f163bdecb542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:40 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Volume 9c0146dd-7357-4309-849b-e3d4858c0123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c0146dd-7357-4309-849b-e3d4858c0123', 'volume_size': 1} Jul 07 17:22:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:40 devstack sudo[92490]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b13b67b2-6ffa-4577-ab92-8fabfc0ca00d tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.d530d11f-7066-4ff9-bc01-e76a546c65ba" returned: 0 in 0.786s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:40 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-b13b67b2-6ffa-4577-ab92-8fabfc0ca00d tempest-VolumesDeleteCascade-1596305227 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.d530d11f-7066-4ff9-bc01-e76a546c65ba is being set with open permissions: ugo+rw Jul 07 17:22:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b13b67b2-6ffa-4577-ab92-8fabfc0ca00d tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.d530d11f-7066-4ff9-bc01-e76a546c65ba {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:40 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.d530d11f-7066-4ff9-bc01-e76a546c65ba Jul 07 17:22:40 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:41 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b13b67b2-6ffa-4577-ab92-8fabfc0ca00d tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.d530d11f-7066-4ff9-bc01-e76a546c65ba" returned: 0 in 0.673s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b13b67b2-6ffa-4577-ab92-8fabfc0ca00d tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:41 devstack sudo[92499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.info Jul 07 17:22:41 devstack sudo[92499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:42 devstack sudo[92499]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b13b67b2-6ffa-4577-ab92-8fabfc0ca00d tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.info" returned: 0 in 0.678s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:42 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-b13b67b2-6ffa-4577-ab92-8fabfc0ca00d tempest-VolumesDeleteCascade-1596305227 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.info is being set with open permissions: ugo+rw Jul 07 17:22:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b13b67b2-6ffa-4577-ab92-8fabfc0ca00d tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:42 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.info Jul 07 17:22:42 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:42 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b13b67b2-6ffa-4577-ab92-8fabfc0ca00d tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.info" returned: 0 in 0.669s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b13b67b2-6ffa-4577-ab92-8fabfc0ca00d tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.047s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-40da4039-c660-4908-a77a-dd17da5958da tempest-SnapshotsActionsTest-529068948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.840s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-40da4039-c660-4908-a77a-dd17da5958da tempest-SnapshotsActionsTest-529068948 None] Creating offline snapshot 18883e9d-22d7-45be-b201-ffb5804cd438 of volume 1d52b2f3-cba6-4075-bdbf-85b6b66f0264 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:22:42 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b13b67b2-6ffa-4577-ab92-8fabfc0ca00d tempest-VolumesDeleteCascade-1596305227 None] Create snapshot completed successfully Jul 07 17:22:42 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd29cf9b-2c93-4447-8c2c-1a0a449f26c8]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-40da4039-c660-4908-a77a-dd17da5958da tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:42 devstack sudo[92505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 Jul 07 17:22:42 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:43 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:22:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Flow 'volume_create_manager' (6dd8f974-649b-44c6-bcb0-be750ecbfb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f9728b-9a9f-4c7f-a75a-b1e9ad9555fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f9728b-9a9f-4c7f-a75a-b1e9ad9555fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-235263263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6bb66e4-05f8-4783-9dae-ef570eed35dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48544ec699c64c7a804e5a76b4638d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d530d11f-7066-4ff9-bc01-e76a546c65ba,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:43Z,use_quota=True,user_id='b7b559ffd7034d97b2358143edfa294b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac7fe96-883b-40d9-a9ae-f9fea62d08a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac7fe96-883b-40d9-a9ae-f9fea62d08a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5d98c2-e837-426f-aaa7-230cc98c1841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5d98c2-e837-426f-aaa7-230cc98c1841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a6bb66e4-05f8-4783-9dae-ef570eed35dd', 'volume_name': 'volume-a6bb66e4-05f8-4783-9dae-ef570eed35dd', 'volume_size': 1, 'snapshot_id': 'd530d11f-7066-4ff9-bc01-e76a546c65ba'}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:43 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf3c7e5-b998-4e2a-9317-f59c120c75c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf3c7e5-b998-4e2a-9317-f59c120c75c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0959e98c-8d14-45bd-9ea8-6dcc859e5f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:43 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Volume a6bb66e4-05f8-4783-9dae-ef570eed35dd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a6bb66e4-05f8-4783-9dae-ef570eed35dd', 'volume_size': 1, 'snapshot_id': 'd530d11f-7066-4ff9-bc01-e76a546c65ba'} Jul 07 17:22:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-40da4039-c660-4908-a77a-dd17da5958da tempest-SnapshotsActionsTest-529068948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7" returned: 0 in 0.862s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:43 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-40da4039-c660-4908-a77a-dd17da5958da tempest-SnapshotsActionsTest-529068948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:22:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-40da4039-c660-4908-a77a-dd17da5958da tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.18883e9d-22d7-45be-b201-ffb5804cd438 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:43 devstack sudo[92510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.18883e9d-22d7-45be-b201-ffb5804cd438 1G Jul 07 17:22:43 devstack sudo[92510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:44 devstack sudo[92510]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-40da4039-c660-4908-a77a-dd17da5958da tempest-SnapshotsActionsTest-529068948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.18883e9d-22d7-45be-b201-ffb5804cd438 1G" returned: 0 in 0.861s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-40da4039-c660-4908-a77a-dd17da5958da tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.18883e9d-22d7-45be-b201-ffb5804cd438 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:44 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.18883e9d-22d7-45be-b201-ffb5804cd438 Jul 07 17:22:44 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:45 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-40da4039-c660-4908-a77a-dd17da5958da tempest-SnapshotsActionsTest-529068948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.18883e9d-22d7-45be-b201-ffb5804cd438" returned: 0 in 0.780s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:45 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-40da4039-c660-4908-a77a-dd17da5958da tempest-SnapshotsActionsTest-529068948 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.18883e9d-22d7-45be-b201-ffb5804cd438 is being set with open permissions: ugo+rw Jul 07 17:22:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-40da4039-c660-4908-a77a-dd17da5958da tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.18883e9d-22d7-45be-b201-ffb5804cd438 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:45 devstack sudo[92522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.18883e9d-22d7-45be-b201-ffb5804cd438 Jul 07 17:22:45 devstack sudo[92522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:46 devstack sudo[92522]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-40da4039-c660-4908-a77a-dd17da5958da tempest-SnapshotsActionsTest-529068948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.18883e9d-22d7-45be-b201-ffb5804cd438" returned: 0 in 0.702s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-40da4039-c660-4908-a77a-dd17da5958da tempest-SnapshotsActionsTest-529068948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.313s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.620s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1068121679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c0146dd-7357-4309-849b-e3d4858c0123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='446e81ef1cc84a43a46e6879cee1f7ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:22:40Z,use_quota=True,user_id='7ae422fed39940ddaaa0decdc98fe50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:22:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Creating volume 9c0146dd-7357-4309-849b-e3d4858c0123 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:22:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:22:46 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:22:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9c0146dd-7357-4309-849b-e3d4858c0123 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:46 devstack sudo[92525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9c0146dd-7357-4309-849b-e3d4858c0123 1073741824 Jul 07 17:22:46 devstack sudo[92525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:46 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-40da4039-c660-4908-a77a-dd17da5958da tempest-SnapshotsActionsTest-529068948 None] Create snapshot completed successfully Jul 07 17:22:47 devstack sudo[92525]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9c0146dd-7357-4309-849b-e3d4858c0123 1073741824" returned: 0 in 1.059s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9c0146dd-7357-4309-849b-e3d4858c0123 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:47 devstack sudo[92533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9c0146dd-7357-4309-849b-e3d4858c0123 Jul 07 17:22:47 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:47 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2e549d93-4cd1-47e2-95db-557e8a21a545 tempest-SnapshotsActionsTest-286588036 None] Acquiring lock "cinder-18883e9d-22d7-45be-b201-ffb5804cd438-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:47 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2e549d93-4cd1-47e2-95db-557e8a21a545 tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-18883e9d-22d7-45be-b201-ffb5804cd438-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:47 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2e549d93-4cd1-47e2-95db-557e8a21a545 tempest-SnapshotsActionsTest-286588036 None] Acquiring lock "cinder-quobyte-1d52b2f3-cba6-4075-bdbf-85b6b66f0264" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:47 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2e549d93-4cd1-47e2-95db-557e8a21a545 tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-quobyte-1d52b2f3-cba6-4075-bdbf-85b6b66f0264" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:47 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2e549d93-4cd1-47e2-95db-557e8a21a545 tempest-SnapshotsActionsTest-286588036 None] Acquiring lock "cinder-quobyte-18883e9d-22d7-45be-b201-ffb5804cd438" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:47 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2e549d93-4cd1-47e2-95db-557e8a21a545 tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-quobyte-18883e9d-22d7-45be-b201-ffb5804cd438" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-2e549d93-4cd1-47e2-95db-557e8a21a545 tempest-SnapshotsActionsTest-286588036 None] Deleting offline snapshot 18883e9d-22d7-45be-b201-ffb5804cd438 of volume 1d52b2f3-cba6-4075-bdbf-85b6b66f0264 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:22:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-2e549d93-4cd1-47e2-95db-557e8a21a545 tempest-SnapshotsActionsTest-286588036 None] snapshot_file for this snap is: volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.18883e9d-22d7-45be-b201-ffb5804cd438 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:22:47 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c9a38a-13a5-4678-9789-8638d42447c4]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2e549d93-4cd1-47e2-95db-557e8a21a545 tempest-SnapshotsActionsTest-286588036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.18883e9d-22d7-45be-b201-ffb5804cd438 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:47 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.18883e9d-22d7-45be-b201-ffb5804cd438 Jul 07 17:22:47 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:47 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9c0146dd-7357-4309-849b-e3d4858c0123" returned: 0 in 0.810s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:22:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.290s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:47 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "cinder-quobyte-d530d11f-7066-4ff9-bc01-e76a546c65ba-a6bb66e4-05f8-4783-9dae-ef570eed35dd" by "_create_volume_from_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02492b2-aa84-425f-841d-f163bdecb542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c0146dd-7357-4309-849b-e3d4858c0123', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5456f0f7-deaa-4460-bea9-599d446c2d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-quobyte-d530d11f-7066-4ff9-bc01-e76a546c65ba-a6bb66e4-05f8-4783-9dae-ef570eed35dd" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Creating volume a6bb66e4-05f8-4783-9dae-ef570eed35dd from snapshot d530d11f-7066-4ff9-bc01-e76a546c65ba {{(pid=87303) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "cinder-quobyte-a6bb66e4-05f8-4783-9dae-ef570eed35dd" by "_copy_volume_from_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-quobyte-a6bb66e4-05f8-4783-9dae-ef570eed35dd" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] snapshot: d530d11f-7066-4ff9-bc01-e76a546c65ba, volume: a6bb66e4-05f8-4783-9dae-ef570eed35dd, {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:22:48 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Volume volume-9c0146dd-7357-4309-849b-e3d4858c0123 (9c0146dd-7357-4309-849b-e3d4858c0123): created successfully Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5456f0f7-deaa-4460-bea9-599d446c2d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Flow 'volume_create_manager' (cfa63574-48d9-4aa5-8272-a49e35f8fc0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:48 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-63b62cca-a2ec-44b1-be2c-4bab88ef9e91 tempest-AttachVolumeTestJSON-285176547 None] Created volume successfully. Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[c658f5ad-a5e0-46b1-b73d-fe747abd1b38]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.d530d11f-7066-4ff9-bc01-e76a546c65ba {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:48 devstack sudo[92543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.d530d11f-7066-4ff9-bc01-e76a546c65ba Jul 07 17:22:48 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:48 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2e549d93-4cd1-47e2-95db-557e8a21a545 tempest-SnapshotsActionsTest-286588036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.18883e9d-22d7-45be-b201-ffb5804cd438" returned: 0 in 0.926s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-2e549d93-4cd1-47e2-95db-557e8a21a545 tempest-SnapshotsActionsTest-286588036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7415bd5-0eeb-4567-869b-63cd50be2549]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2e549d93-4cd1-47e2-95db-557e8a21a545 tempest-SnapshotsActionsTest-286588036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:48 devstack sudo[92548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 Jul 07 17:22:48 devstack sudo[92548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:48 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.d530d11f-7066-4ff9-bc01-e76a546c65ba" returned: 0 in 0.866s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Creating direct copy from snapshot {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8fe937-5055-4abd-b511-ebad7515f1ee]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:49 devstack sudo[92558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 Jul 07 17:22:49 devstack sudo[92558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:49 devstack sudo[92548]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2e549d93-4cd1-47e2-95db-557e8a21a545 tempest-SnapshotsActionsTest-286588036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7" returned: 0 in 0.843s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-2e549d93-4cd1-47e2-95db-557e8a21a545 tempest-SnapshotsActionsTest-286588036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:22:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2e549d93-4cd1-47e2-95db-557e8a21a545 tempest-SnapshotsActionsTest-286588036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.18883e9d-22d7-45be-b201-ffb5804cd438 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:49 devstack sudo[92563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.18883e9d-22d7-45be-b201-ffb5804cd438 Jul 07 17:22:49 devstack sudo[92563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:49 devstack sudo[92558]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22" returned: 0 in 0.785s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:49 devstack cinder-volume[87303]: DEBUG cinder.utils [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Path /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a6bb66e4-05f8-4783-9dae-ef570eed35dd not found in is_blk_device check {{(pid=87303) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:22:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a6bb66e4-05f8-4783-9dae-ef570eed35dd {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:49 devstack sudo[92568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a6bb66e4-05f8-4783-9dae-ef570eed35dd Jul 07 17:22:49 devstack sudo[92568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:50 devstack sudo[92563]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2e549d93-4cd1-47e2-95db-557e8a21a545 tempest-SnapshotsActionsTest-286588036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.18883e9d-22d7-45be-b201-ffb5804cd438" returned: 0 in 0.926s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2e549d93-4cd1-47e2-95db-557e8a21a545 tempest-SnapshotsActionsTest-286588036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.18883e9d-22d7-45be-b201-ffb5804cd438 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:50 devstack sudo[92575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.18883e9d-22d7-45be-b201-ffb5804cd438 Jul 07 17:22:50 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-6bc3e64a-2cb0-462c-b319-ac434c7444a6 req-8be3b7c1-6a31-4cb6-a08c-b3cd15673ef6 tempest-ServerActionsTestOtherA-1941139839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:51 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2e549d93-4cd1-47e2-95db-557e8a21a545 tempest-SnapshotsActionsTest-286588036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.18883e9d-22d7-45be-b201-ffb5804cd438" returned: 0 in 1.050s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2e549d93-4cd1-47e2-95db-557e8a21a545 tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-quobyte-18883e9d-22d7-45be-b201-ffb5804cd438" released by "_delete_snapshot" :: held 3.919s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2e549d93-4cd1-47e2-95db-557e8a21a545 tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-quobyte-1d52b2f3-cba6-4075-bdbf-85b6b66f0264" released by "delete_snapshot" :: held 3.956s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:51 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-2e549d93-4cd1-47e2-95db-557e8a21a545 tempest-SnapshotsActionsTest-286588036 None] Created reservations ['5da6b681-e9fe-4cf5-be5a-d316f6b6b9b8', '39916ea1-1c6d-4436-af0d-6586e79407b0', '587e2a6a-554c-4963-971e-4e331ec20992', '3b884f63-c25b-44a1-a31c-c01169ffc4b5'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:22:51 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-2e549d93-4cd1-47e2-95db-557e8a21a545 tempest-SnapshotsActionsTest-286588036 None] Delete snapshot completed successfully. Jul 07 17:22:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2e549d93-4cd1-47e2-95db-557e8a21a545 tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-18883e9d-22d7-45be-b201-ffb5804cd438-delete_snapshot" released by "delete_snapshot" :: held 4.411s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-30538fd3-eceb-4c64-b77b-595a92380e20 tempest-SnapshotsActionsTest-529068948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-a5d5375a-7f00-4f06-8b41-f4e9630cfaf4 req-d3a0220f-2a92-4560-981e-cd7ee51a9325 tempest-AttachVolumeTestJSON-285176547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:55 devstack sudo[92568]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a6bb66e4-05f8-4783-9dae-ef570eed35dd" returned: 0 in 5.914s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:55 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[397946bb-2c01-47ad-95f5-6ec62b9b1783]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:55 devstack sudo[92650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 Jul 07 17:22:55 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:22:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:22:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:22:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:22:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:56 devstack sudo[92655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:22:56 devstack sudo[92655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:56 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22" returned: 0 in 1.036s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:56 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Image conversion details: src /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a6bb66e4-05f8-4783-9dae-ef570eed35dd {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:22:56 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Converted 1024.00 MB image at 173.12 MB/s Jul 07 17:22:56 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a6bb66e4-05f8-4783-9dae-ef570eed35dd is being set with open permissions: ugo+rw Jul 07 17:22:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a6bb66e4-05f8-4783-9dae-ef570eed35dd {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:56 devstack sudo[92657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a6bb66e4-05f8-4783-9dae-ef570eed35dd Jul 07 17:22:56 devstack sudo[92657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:57 devstack sudo[92655]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.685s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:22:57 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:22:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:22:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:22:57 devstack sudo[92657]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a6bb66e4-05f8-4783-9dae-ef570eed35dd" returned: 0 in 0.700s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-quobyte-a6bb66e4-05f8-4783-9dae-ef570eed35dd" released by "_copy_volume_from_snapshot" :: held 9.425s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-quobyte-d530d11f-7066-4ff9-bc01-e76a546c65ba-a6bb66e4-05f8-4783-9dae-ef570eed35dd" released by "_create_volume_from_snapshot" :: held 9.463s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:22:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.499s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-6bc3e64a-2cb0-462c-b319-ac434c7444a6 req-8be3b7c1-6a31-4cb6-a08c-b3cd15673ef6 tempest-ServerActionsTestOtherA-1941139839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.462s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:57 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dfc310-ffe8-4ea5-ac18-0dc0a3b3dbfe]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-6bc3e64a-2cb0-462c-b319-ac434c7444a6 req-8be3b7c1-6a31-4cb6-a08c-b3cd15673ef6 tempest-ServerActionsTestOtherA-1941139839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-683d0b57-496d-4193-bf08-0c324ad5207a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0959e98c-8d14-45bd-9ea8-6dcc859e5f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6bb66e4-05f8-4783-9dae-ef570eed35dd', 'volume_size': 1, 'snapshot_id': 'd530d11f-7066-4ff9-bc01-e76a546c65ba'}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42527e8-7a25-4f73-97c1-42de7e1abb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:22:57 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Volume volume-a6bb66e4-05f8-4783-9dae-ef570eed35dd (a6bb66e4-05f8-4783-9dae-ef570eed35dd): created successfully Jul 07 17:22:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42527e8-7a25-4f73-97c1-42de7e1abb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:22:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Flow 'volume_create_manager' (6dd8f974-649b-44c6-bcb0-be750ecbfb17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:22:57 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-935750e8-0fc5-4bda-a99e-a730a867d11e tempest-VolumesDeleteCascade-1596305227 None] Created volume successfully. Jul 07 17:22:57 devstack sudo[92661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-683d0b57-496d-4193-bf08-0c324ad5207a Jul 07 17:22:57 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:58 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-6bc3e64a-2cb0-462c-b319-ac434c7444a6 req-8be3b7c1-6a31-4cb6-a08c-b3cd15673ef6 tempest-ServerActionsTestOtherA-1941139839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-683d0b57-496d-4193-bf08-0c324ad5207a" returned: 0 in 0.840s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-6bc3e64a-2cb0-462c-b319-ac434c7444a6 req-8be3b7c1-6a31-4cb6-a08c-b3cd15673ef6 tempest-ServerActionsTestOtherA-1941139839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.863s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:22:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-30538fd3-eceb-4c64-b77b-595a92380e20 tempest-SnapshotsActionsTest-529068948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.371s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:22:58 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-30538fd3-eceb-4c64-b77b-595a92380e20 tempest-SnapshotsActionsTest-529068948 None] Creating offline snapshot 683fd8d8-2b5d-4a83-bffa-8f32683ec470 of volume 1d52b2f3-cba6-4075-bdbf-85b6b66f0264 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:22:58 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d48181d-8a7c-4beb-90ec-efea139ca585]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-30538fd3-eceb-4c64-b77b-595a92380e20 tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-6bc3e64a-2cb0-462c-b319-ac434c7444a6 req-8be3b7c1-6a31-4cb6-a08c-b3cd15673ef6 tempest-ServerActionsTestOtherA-1941139839 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2', 'name': 'volume-683d0b57-496d-4193-bf08-0c324ad5207a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f22c03e-80be-4b0e-a096-321a7c43e11d', 'enforce_multipath': True} {{(pid=87303) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:22:58 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-6bc3e64a-2cb0-462c-b319-ac434c7444a6 req-8be3b7c1-6a31-4cb6-a08c-b3cd15673ef6 tempest-ServerActionsTestOtherA-1941139839 None] attachment_update completed successfully. Jul 07 17:22:58 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 Jul 07 17:22:58 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:59 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Jul 07 17:22:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-30538fd3-eceb-4c64-b77b-595a92380e20 tempest-SnapshotsActionsTest-529068948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7" returned: 0 in 0.873s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:22:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-30538fd3-eceb-4c64-b77b-595a92380e20 tempest-SnapshotsActionsTest-529068948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:22:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-30538fd3-eceb-4c64-b77b-595a92380e20 tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.683fd8d8-2b5d-4a83-bffa-8f32683ec470 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:59 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.683fd8d8-2b5d-4a83-bffa-8f32683ec470 1G Jul 07 17:22:59 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:22:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "cinder-eaccecb9-9fa6-4b13-bf11-84e9dde91c22-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-eaccecb9-9fa6-4b13-bf11-84e9dde91c22-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Performing cascade delete. {{(pid=87303) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 17:22:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "cinder-d530d11f-7066-4ff9-bc01-e76a546c65ba-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-d530d11f-7066-4ff9-bc01-e76a546c65ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "cinder-quobyte-eaccecb9-9fa6-4b13-bf11-84e9dde91c22" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-quobyte-eaccecb9-9fa6-4b13-bf11-84e9dde91c22" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "cinder-quobyte-d530d11f-7066-4ff9-bc01-e76a546c65ba" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:22:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-quobyte-d530d11f-7066-4ff9-bc01-e76a546c65ba" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:22:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Deleting offline snapshot d530d11f-7066-4ff9-bc01-e76a546c65ba of volume eaccecb9-9fa6-4b13-bf11-84e9dde91c22 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:22:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] snapshot_file for this snap is: volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.d530d11f-7066-4ff9-bc01-e76a546c65ba {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:22:59 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed305a54-23c5-453a-b615-11105508f5de]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:22:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.d530d11f-7066-4ff9-bc01-e76a546c65ba {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:22:59 devstack sudo[92675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.d530d11f-7066-4ff9-bc01-e76a546c65ba Jul 07 17:22:59 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:00 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-30538fd3-eceb-4c64-b77b-595a92380e20 tempest-SnapshotsActionsTest-529068948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.683fd8d8-2b5d-4a83-bffa-8f32683ec470 1G" returned: 0 in 0.932s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-30538fd3-eceb-4c64-b77b-595a92380e20 tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.683fd8d8-2b5d-4a83-bffa-8f32683ec470 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:00 devstack sudo[92694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.683fd8d8-2b5d-4a83-bffa-8f32683ec470 Jul 07 17:23:00 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:00 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.d530d11f-7066-4ff9-bc01-e76a546c65ba" returned: 0 in 0.934s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:00 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:23:00 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e21e294-707a-4408-b6f3-ed55d9e98df1]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:00 devstack sudo[92700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 Jul 07 17:23:00 devstack sudo[92700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:01 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-30538fd3-eceb-4c64-b77b-595a92380e20 tempest-SnapshotsActionsTest-529068948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.683fd8d8-2b5d-4a83-bffa-8f32683ec470" returned: 0 in 0.806s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:01 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-30538fd3-eceb-4c64-b77b-595a92380e20 tempest-SnapshotsActionsTest-529068948 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.683fd8d8-2b5d-4a83-bffa-8f32683ec470 is being set with open permissions: ugo+rw Jul 07 17:23:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-30538fd3-eceb-4c64-b77b-595a92380e20 tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.683fd8d8-2b5d-4a83-bffa-8f32683ec470 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:01 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.683fd8d8-2b5d-4a83-bffa-8f32683ec470 Jul 07 17:23:01 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:01 devstack sudo[92700]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22" returned: 0 in 0.883s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.d530d11f-7066-4ff9-bc01-e76a546c65ba {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:01 devstack sudo[92710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.d530d11f-7066-4ff9-bc01-e76a546c65ba Jul 07 17:23:01 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:01 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-30538fd3-eceb-4c64-b77b-595a92380e20 tempest-SnapshotsActionsTest-529068948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.683fd8d8-2b5d-4a83-bffa-8f32683ec470" returned: 0 in 0.707s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-30538fd3-eceb-4c64-b77b-595a92380e20 tempest-SnapshotsActionsTest-529068948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.459s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-a5d5375a-7f00-4f06-8b41-f4e9630cfaf4 req-d3a0220f-2a92-4560-981e-cd7ee51a9325 tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.611s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:01 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-30538fd3-eceb-4c64-b77b-595a92380e20 tempest-SnapshotsActionsTest-529068948 None] Create snapshot completed successfully Jul 07 17:23:01 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb50653-c11a-495d-965e-e7dfde298f44]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-a5d5375a-7f00-4f06-8b41-f4e9630cfaf4 req-d3a0220f-2a92-4560-981e-cd7ee51a9325 tempest-AttachVolumeTestJSON-285176547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9c0146dd-7357-4309-849b-e3d4858c0123 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:01 devstack sudo[92713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9c0146dd-7357-4309-849b-e3d4858c0123 Jul 07 17:23:01 devstack sudo[92713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:02 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.d530d11f-7066-4ff9-bc01-e76a546c65ba" returned: 0 in 0.869s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.d530d11f-7066-4ff9-bc01-e76a546c65ba {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:02 devstack sudo[92719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.d530d11f-7066-4ff9-bc01-e76a546c65ba Jul 07 17:23:02 devstack sudo[92719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:02 devstack sudo[92713]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-a5d5375a-7f00-4f06-8b41-f4e9630cfaf4 req-d3a0220f-2a92-4560-981e-cd7ee51a9325 tempest-AttachVolumeTestJSON-285176547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9c0146dd-7357-4309-849b-e3d4858c0123" returned: 0 in 0.905s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-a5d5375a-7f00-4f06-8b41-f4e9630cfaf4 req-d3a0220f-2a92-4560-981e-cd7ee51a9325 tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.948s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-411e9a06-a834-4a91-869a-86394c0d3bfb tempest-SnapshotsActionsTest-286588036 None] Acquiring lock "cinder-683fd8d8-2b5d-4a83-bffa-8f32683ec470-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-a5d5375a-7f00-4f06-8b41-f4e9630cfaf4 req-d3a0220f-2a92-4560-981e-cd7ee51a9325 tempest-AttachVolumeTestJSON-285176547 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2', 'name': 'volume-9c0146dd-7357-4309-849b-e3d4858c0123', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aec2ffd1-7636-426b-a15b-ffde7fe448bd', 'enforce_multipath': True} {{(pid=87303) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:23:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-411e9a06-a834-4a91-869a-86394c0d3bfb tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-683fd8d8-2b5d-4a83-bffa-8f32683ec470-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-411e9a06-a834-4a91-869a-86394c0d3bfb tempest-SnapshotsActionsTest-286588036 None] Acquiring lock "cinder-quobyte-1d52b2f3-cba6-4075-bdbf-85b6b66f0264" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-411e9a06-a834-4a91-869a-86394c0d3bfb tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-quobyte-1d52b2f3-cba6-4075-bdbf-85b6b66f0264" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-411e9a06-a834-4a91-869a-86394c0d3bfb tempest-SnapshotsActionsTest-286588036 None] Acquiring lock "cinder-quobyte-683fd8d8-2b5d-4a83-bffa-8f32683ec470" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-411e9a06-a834-4a91-869a-86394c0d3bfb tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-quobyte-683fd8d8-2b5d-4a83-bffa-8f32683ec470" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:02 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-411e9a06-a834-4a91-869a-86394c0d3bfb tempest-SnapshotsActionsTest-286588036 None] Deleting offline snapshot 683fd8d8-2b5d-4a83-bffa-8f32683ec470 of volume 1d52b2f3-cba6-4075-bdbf-85b6b66f0264 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:23:02 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-411e9a06-a834-4a91-869a-86394c0d3bfb tempest-SnapshotsActionsTest-286588036 None] snapshot_file for this snap is: volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.683fd8d8-2b5d-4a83-bffa-8f32683ec470 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:23:02 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e6667c-23de-41d6-83a4-aaaa710c4943]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-411e9a06-a834-4a91-869a-86394c0d3bfb tempest-SnapshotsActionsTest-286588036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.683fd8d8-2b5d-4a83-bffa-8f32683ec470 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:02 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-a5d5375a-7f00-4f06-8b41-f4e9630cfaf4 req-d3a0220f-2a92-4560-981e-cd7ee51a9325 tempest-AttachVolumeTestJSON-285176547 None] attachment_update completed successfully. Jul 07 17:23:03 devstack sudo[92724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.683fd8d8-2b5d-4a83-bffa-8f32683ec470 Jul 07 17:23:03 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:03 devstack sudo[92719]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22.d530d11f-7066-4ff9-bc01-e76a546c65ba" returned: 0 in 0.774s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-quobyte-d530d11f-7066-4ff9-bc01-e76a546c65ba" released by "_delete_snapshot" :: held 3.581s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-quobyte-eaccecb9-9fa6-4b13-bf11-84e9dde91c22" released by "delete_snapshot" :: held 3.613s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:03 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Created reservations ['7622903c-d645-4e28-863e-d15815c350bc', 'e89c03b7-d3d9-4e01-a28a-bc1e32d53e91', '98da886b-afb2-4690-bb3c-2ebf48e4f3af', '4e7ccfad-83f6-4389-96fb-e9696530d0d3'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:03 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Delete snapshot completed successfully. Jul 07 17:23:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-d530d11f-7066-4ff9-bc01-e76a546c65ba-delete_snapshot" released by "delete_snapshot" :: held 3.819s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:03 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Snapshots deleted, issuing volume delete {{(pid=87303) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 17:23:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "cinder-quobyte-eaccecb9-9fa6-4b13-bf11-84e9dde91c22" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-quobyte-eaccecb9-9fa6-4b13-bf11-84e9dde91c22" acquired by "delete_volume" :: waited 0.016s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:03 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ee64d5-6bfb-41fd-9d00-c339e65c3d45]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:03 devstack sudo[92727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 Jul 07 17:23:03 devstack sudo[92727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:03 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-411e9a06-a834-4a91-869a-86394c0d3bfb tempest-SnapshotsActionsTest-286588036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.683fd8d8-2b5d-4a83-bffa-8f32683ec470" returned: 0 in 1.072s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-411e9a06-a834-4a91-869a-86394c0d3bfb tempest-SnapshotsActionsTest-286588036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:23:04 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1caf13-9287-440a-88bb-60210bfb0642]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-411e9a06-a834-4a91-869a-86394c0d3bfb tempest-SnapshotsActionsTest-286588036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:04 devstack sudo[92734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 Jul 07 17:23:04 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:04 devstack sudo[92727]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22" returned: 0 in 1.035s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:04 devstack sudo[92739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22 Jul 07 17:23:04 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:05 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-411e9a06-a834-4a91-869a-86394c0d3bfb tempest-SnapshotsActionsTest-286588036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7" returned: 0 in 1.082s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-411e9a06-a834-4a91-869a-86394c0d3bfb tempest-SnapshotsActionsTest-286588036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:23:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-411e9a06-a834-4a91-869a-86394c0d3bfb tempest-SnapshotsActionsTest-286588036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.683fd8d8-2b5d-4a83-bffa-8f32683ec470 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:05 devstack sudo[92748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.683fd8d8-2b5d-4a83-bffa-8f32683ec470 Jul 07 17:23:05 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:05 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-eaccecb9-9fa6-4b13-bf11-84e9dde91c22" returned: 0 in 0.789s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:05 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-quobyte-eaccecb9-9fa6-4b13-bf11-84e9dde91c22" released by "delete_volume" :: held 1.892s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:05 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=86,cinder:INSERT=18,cinder:UPDATE=70,cinder:DELETE=4 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:23:05 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Created reservations ['63bdc655-561f-49ec-8fe4-cbea53d67c6f', '71504209-3abf-42e7-a7ef-1844558ad4dd', '45fd68de-7dee-43f6-b902-e11e68fb7a6d', '8ec745bb-897d-4353-a1a0-b86018fa8fe3'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:05 devstack sudo[92750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:23:05 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:06 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-411e9a06-a834-4a91-869a-86394c0d3bfb tempest-SnapshotsActionsTest-286588036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.683fd8d8-2b5d-4a83-bffa-8f32683ec470" returned: 0 in 0.930s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-411e9a06-a834-4a91-869a-86394c0d3bfb tempest-SnapshotsActionsTest-286588036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.683fd8d8-2b5d-4a83-bffa-8f32683ec470 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:06 devstack sudo[92756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.683fd8d8-2b5d-4a83-bffa-8f32683ec470 Jul 07 17:23:06 devstack sudo[92756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:06 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.823s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:06 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:23:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ebbd2fda-0c2f-4d64-8dd2-f8fb25453f05 tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "cinder-a6bb66e4-05f8-4783-9dae-ef570eed35dd-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:06 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Deleted volume successfully. Jul 07 17:23:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ebbd2fda-0c2f-4d64-8dd2-f8fb25453f05 tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-a6bb66e4-05f8-4783-9dae-ef570eed35dd-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d76387e8-9254-4c75-a9cb-ccf9645f111b tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-eaccecb9-9fa6-4b13-bf11-84e9dde91c22-delete_volume" released by "delete_volume" :: held 6.872s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:06 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=85,cinder:UPDATE=73,cinder:DELETE=11,cinder:INSERT=19 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:23:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ebbd2fda-0c2f-4d64-8dd2-f8fb25453f05 tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "cinder-quobyte-a6bb66e4-05f8-4783-9dae-ef570eed35dd" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ebbd2fda-0c2f-4d64-8dd2-f8fb25453f05 tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-quobyte-a6bb66e4-05f8-4783-9dae-ef570eed35dd" acquired by "delete_volume" :: waited 0.031s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:06 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cf36ca-9030-4724-8b57-e3810cdca18f]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ebbd2fda-0c2f-4d64-8dd2-f8fb25453f05 tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a6bb66e4-05f8-4783-9dae-ef570eed35dd {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:06 devstack sudo[92758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a6bb66e4-05f8-4783-9dae-ef570eed35dd Jul 07 17:23:06 devstack sudo[92758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:06 devstack sudo[92756]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-411e9a06-a834-4a91-869a-86394c0d3bfb tempest-SnapshotsActionsTest-286588036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.683fd8d8-2b5d-4a83-bffa-8f32683ec470" returned: 0 in 0.878s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-411e9a06-a834-4a91-869a-86394c0d3bfb tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-quobyte-683fd8d8-2b5d-4a83-bffa-8f32683ec470" released by "_delete_snapshot" :: held 4.126s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-411e9a06-a834-4a91-869a-86394c0d3bfb tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-quobyte-1d52b2f3-cba6-4075-bdbf-85b6b66f0264" released by "delete_snapshot" :: held 4.166s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:07 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-411e9a06-a834-4a91-869a-86394c0d3bfb tempest-SnapshotsActionsTest-286588036 None] Created reservations ['4df57f83-1def-449e-a929-bf9211776f68', '2d76f9b6-33ba-46fb-bae3-24d2063342bc', 'f8341d36-49ec-4d51-9d43-b4c634f2851f', 'faf46ce8-4940-4404-8e10-aa8f9dcf1e0c'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:07 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-f0b2a7bd-bf7c-4d2e-9ce2-c3437e21bfa1 req-28cfb21d-c535-482f-8c9e-303d95d44d95 tempest-ServerActionsTestOtherA-1941139839 None] Terminate volume connection completed successfully. Jul 07 17:23:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-f0b2a7bd-bf7c-4d2e-9ce2-c3437e21bfa1 req-28cfb21d-c535-482f-8c9e-303d95d44d95 tempest-ServerActionsTestOtherA-1941139839 None] Deleting attachment 1f22c03e-80be-4b0e-a096-321a7c43e11d. {{(pid=87303) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:23:07 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-411e9a06-a834-4a91-869a-86394c0d3bfb tempest-SnapshotsActionsTest-286588036 None] Delete snapshot completed successfully. Jul 07 17:23:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-411e9a06-a834-4a91-869a-86394c0d3bfb tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-683fd8d8-2b5d-4a83-bffa-8f32683ec470-delete_snapshot" released by "delete_snapshot" :: held 4.443s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:07 devstack sudo[92758]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ebbd2fda-0c2f-4d64-8dd2-f8fb25453f05 tempest-VolumesDeleteCascade-1596305227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a6bb66e4-05f8-4783-9dae-ef570eed35dd" returned: 0 in 0.933s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ebbd2fda-0c2f-4d64-8dd2-f8fb25453f05 tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a6bb66e4-05f8-4783-9dae-ef570eed35dd {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:07 devstack sudo[92774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a6bb66e4-05f8-4783-9dae-ef570eed35dd Jul 07 17:23:07 devstack sudo[92774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:08 devstack sudo[92774]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ebbd2fda-0c2f-4d64-8dd2-f8fb25453f05 tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a6bb66e4-05f8-4783-9dae-ef570eed35dd" returned: 0 in 0.730s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ebbd2fda-0c2f-4d64-8dd2-f8fb25453f05 tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-quobyte-a6bb66e4-05f8-4783-9dae-ef570eed35dd" released by "delete_volume" :: held 1.722s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:08 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-ebbd2fda-0c2f-4d64-8dd2-f8fb25453f05 tempest-VolumesDeleteCascade-1596305227 None] Created reservations ['ebaafd63-f9e1-409d-a0bf-346968f7817b', '9f5ca6dc-a4af-4feb-bc13-f6fda5cc79eb', '1357fef9-c1bc-4f0a-8759-65aa4fa977e6', '62d27e5c-68d4-4ad1-aae2-5a25473d5b31'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ebbd2fda-0c2f-4d64-8dd2-f8fb25453f05 tempest-VolumesDeleteCascade-1596305227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ebbd2fda-0c2f-4d64-8dd2-f8fb25453f05 tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ebbd2fda-0c2f-4d64-8dd2-f8fb25453f05 tempest-VolumesDeleteCascade-1596305227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ebbd2fda-0c2f-4d64-8dd2-f8fb25453f05 tempest-VolumesDeleteCascade-1596305227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ebbd2fda-0c2f-4d64-8dd2-f8fb25453f05 tempest-VolumesDeleteCascade-1596305227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ebbd2fda-0c2f-4d64-8dd2-f8fb25453f05 tempest-VolumesDeleteCascade-1596305227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:08 devstack sudo[92778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:23:08 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c117961f-8e36-4c84-a92f-d8222491c0de tempest-SnapshotsActionsTest-529068948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c117961f-8e36-4c84-a92f-d8222491c0de tempest-SnapshotsActionsTest-529068948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-c117961f-8e36-4c84-a92f-d8222491c0de tempest-SnapshotsActionsTest-529068948 None] Creating offline snapshot 3937414d-7ade-43bd-a7c0-ec28d9fa978f of volume 1d52b2f3-cba6-4075-bdbf-85b6b66f0264 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:23:09 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef45b59-e739-4efa-b177-75870f82ec31]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c117961f-8e36-4c84-a92f-d8222491c0de tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:09 devstack sudo[92800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 Jul 07 17:23:09 devstack sudo[92800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:09 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-a360fcc3-71d3-4688-8d6c-9cf9f1ea7508 req-ddfff9c2-fa33-438c-bc39-29a6efa9c4d1 tempest-AttachVolumeTestJSON-285176547 None] Terminate volume connection completed successfully. Jul 07 17:23:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-a360fcc3-71d3-4688-8d6c-9cf9f1ea7508 req-ddfff9c2-fa33-438c-bc39-29a6efa9c4d1 tempest-AttachVolumeTestJSON-285176547 None] Deleting attachment 44a2833c-f97c-4202-a649-5e7c27b75c4b. {{(pid=87303) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:23:09 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ebbd2fda-0c2f-4d64-8dd2-f8fb25453f05 tempest-VolumesDeleteCascade-1596305227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.321s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:09 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-ebbd2fda-0c2f-4d64-8dd2-f8fb25453f05 tempest-VolumesDeleteCascade-1596305227 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:23:09 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-ebbd2fda-0c2f-4d64-8dd2-f8fb25453f05 tempest-VolumesDeleteCascade-1596305227 None] Deleted volume successfully. Jul 07 17:23:09 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ebbd2fda-0c2f-4d64-8dd2-f8fb25453f05 tempest-VolumesDeleteCascade-1596305227 None] Lock "cinder-a6bb66e4-05f8-4783-9dae-ef570eed35dd-delete_volume" released by "delete_volume" :: held 3.365s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-f0b2a7bd-bf7c-4d2e-9ce2-c3437e21bfa1 req-9941d787-c1bc-497b-8c9a-a28626a990eb tempest-ServerActionsTestOtherA-1941139839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:10 devstack sudo[92800]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c117961f-8e36-4c84-a92f-d8222491c0de tempest-SnapshotsActionsTest-529068948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7" returned: 0 in 1.244s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-c117961f-8e36-4c84-a92f-d8222491c0de tempest-SnapshotsActionsTest-529068948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:23:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c117961f-8e36-4c84-a92f-d8222491c0de tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.3937414d-7ade-43bd-a7c0-ec28d9fa978f 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:10 devstack sudo[92817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.3937414d-7ade-43bd-a7c0-ec28d9fa978f 1G Jul 07 17:23:10 devstack sudo[92817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:11 devstack sudo[92817]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c117961f-8e36-4c84-a92f-d8222491c0de tempest-SnapshotsActionsTest-529068948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.3937414d-7ade-43bd-a7c0-ec28d9fa978f 1G" returned: 0 in 1.146s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c117961f-8e36-4c84-a92f-d8222491c0de tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.3937414d-7ade-43bd-a7c0-ec28d9fa978f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:11 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.3937414d-7ade-43bd-a7c0-ec28d9fa978f Jul 07 17:23:11 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:11 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-e0aa328a-8db0-4075-93e5-742b569c5721 req-505ddac4-baa1-473e-a054-62c2312448fc tempest-AttachVolumeTestJSON-285176547 None] Terminate volume connection completed successfully. Jul 07 17:23:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-e0aa328a-8db0-4075-93e5-742b569c5721 req-505ddac4-baa1-473e-a054-62c2312448fc tempest-AttachVolumeTestJSON-285176547 None] Deleting attachment aec2ffd1-7636-426b-a15b-ffde7fe448bd. {{(pid=87303) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:23:12 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c117961f-8e36-4c84-a92f-d8222491c0de tempest-SnapshotsActionsTest-529068948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.3937414d-7ade-43bd-a7c0-ec28d9fa978f" returned: 0 in 0.832s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:12 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-c117961f-8e36-4c84-a92f-d8222491c0de tempest-SnapshotsActionsTest-529068948 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.3937414d-7ade-43bd-a7c0-ec28d9fa978f is being set with open permissions: ugo+rw Jul 07 17:23:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c117961f-8e36-4c84-a92f-d8222491c0de tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.3937414d-7ade-43bd-a7c0-ec28d9fa978f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:12 devstack sudo[92848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.3937414d-7ade-43bd-a7c0-ec28d9fa978f Jul 07 17:23:12 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:13 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c117961f-8e36-4c84-a92f-d8222491c0de tempest-SnapshotsActionsTest-529068948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.3937414d-7ade-43bd-a7c0-ec28d9fa978f" returned: 0 in 0.838s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c117961f-8e36-4c84-a92f-d8222491c0de tempest-SnapshotsActionsTest-529068948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.288s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-f0b2a7bd-bf7c-4d2e-9ce2-c3437e21bfa1 req-9941d787-c1bc-497b-8c9a-a28626a990eb tempest-ServerActionsTestOtherA-1941139839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.116s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:13 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[36db0ab7-6981-4c89-b288-f52cceb9f060]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-f0b2a7bd-bf7c-4d2e-9ce2-c3437e21bfa1 req-9941d787-c1bc-497b-8c9a-a28626a990eb tempest-ServerActionsTestOtherA-1941139839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-683d0b57-496d-4193-bf08-0c324ad5207a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:13 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-c117961f-8e36-4c84-a92f-d8222491c0de tempest-SnapshotsActionsTest-529068948 None] Create snapshot completed successfully Jul 07 17:23:13 devstack sudo[92851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-683d0b57-496d-4193-bf08-0c324ad5207a Jul 07 17:23:13 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:14 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-f0b2a7bd-bf7c-4d2e-9ce2-c3437e21bfa1 req-9941d787-c1bc-497b-8c9a-a28626a990eb tempest-ServerActionsTestOtherA-1941139839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-683d0b57-496d-4193-bf08-0c324ad5207a" returned: 0 in 0.910s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-f0b2a7bd-bf7c-4d2e-9ce2-c3437e21bfa1 req-9941d787-c1bc-497b-8c9a-a28626a990eb tempest-ServerActionsTestOtherA-1941139839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.931s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-f0b2a7bd-bf7c-4d2e-9ce2-c3437e21bfa1 req-9941d787-c1bc-497b-8c9a-a28626a990eb tempest-ServerActionsTestOtherA-1941139839 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2', 'name': 'volume-683d0b57-496d-4193-bf08-0c324ad5207a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90902b6e-198c-4a27-a7ca-ed4c64c8bc1f', 'enforce_multipath': True} {{(pid=87303) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:23:14 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-f0b2a7bd-bf7c-4d2e-9ce2-c3437e21bfa1 req-9941d787-c1bc-497b-8c9a-a28626a990eb tempest-ServerActionsTestOtherA-1941139839 None] attachment_update completed successfully. Jul 07 17:23:14 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e57bebb9-cf16-4a00-b6be-652d862e91c9 tempest-SnapshotsActionsTest-286588036 None] Acquiring lock "cinder-3937414d-7ade-43bd-a7c0-ec28d9fa978f-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:14 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e57bebb9-cf16-4a00-b6be-652d862e91c9 tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-3937414d-7ade-43bd-a7c0-ec28d9fa978f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:14 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e57bebb9-cf16-4a00-b6be-652d862e91c9 tempest-SnapshotsActionsTest-286588036 None] Acquiring lock "cinder-quobyte-1d52b2f3-cba6-4075-bdbf-85b6b66f0264" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:14 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e57bebb9-cf16-4a00-b6be-652d862e91c9 tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-quobyte-1d52b2f3-cba6-4075-bdbf-85b6b66f0264" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:14 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e57bebb9-cf16-4a00-b6be-652d862e91c9 tempest-SnapshotsActionsTest-286588036 None] Acquiring lock "cinder-quobyte-3937414d-7ade-43bd-a7c0-ec28d9fa978f" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:14 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e57bebb9-cf16-4a00-b6be-652d862e91c9 tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-quobyte-3937414d-7ade-43bd-a7c0-ec28d9fa978f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e57bebb9-cf16-4a00-b6be-652d862e91c9 tempest-SnapshotsActionsTest-286588036 None] Deleting offline snapshot 3937414d-7ade-43bd-a7c0-ec28d9fa978f of volume 1d52b2f3-cba6-4075-bdbf-85b6b66f0264 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:23:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e57bebb9-cf16-4a00-b6be-652d862e91c9 tempest-SnapshotsActionsTest-286588036 None] snapshot_file for this snap is: volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.3937414d-7ade-43bd-a7c0-ec28d9fa978f {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:23:14 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:23:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Flow 'volume_create_manager' (5e6c174c-1006-445c-a4ab-187bcbfe13b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:23:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b55b73a-029a-4144-aece-4eb48a6715c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:14 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ba3c9e-e373-426d-80a8-bacdf7b887b3]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e57bebb9-cf16-4a00-b6be-652d862e91c9 tempest-SnapshotsActionsTest-286588036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.3937414d-7ade-43bd-a7c0-ec28d9fa978f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b55b73a-029a-4144-aece-4eb48a6715c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2106009683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf7a489-3800-4f24-895d-e864162db302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8ee460382724c13acb84b50498c7c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:15Z,use_quota=True,user_id='4dafb3cd77ae47629849f4375e315926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1e89cf-6490-42f9-b638-cc92fb4c43e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1e89cf-6490-42f9-b638-cc92fb4c43e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f531ad58-647e-4883-98b7-d3cd59fea83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f531ad58-647e-4883-98b7-d3cd59fea83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cf7a489-3800-4f24-895d-e864162db302', 'volume_name': 'volume-6cf7a489-3800-4f24-895d-e864162db302', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d44051-34d3-4928-807a-a153932e2cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d44051-34d3-4928-807a-a153932e2cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebce59f0-280a-42f1-ba8e-5ee91d9db12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:15 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Volume 6cf7a489-3800-4f24-895d-e864162db302: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cf7a489-3800-4f24-895d-e864162db302', 'volume_size': 1} Jul 07 17:23:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2106009683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf7a489-3800-4f24-895d-e864162db302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8ee460382724c13acb84b50498c7c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:15Z,use_quota=True,user_id='4dafb3cd77ae47629849f4375e315926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:23:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Creating volume 6cf7a489-3800-4f24-895d-e864162db302 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:23:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:23:15 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:23:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6cf7a489-3800-4f24-895d-e864162db302 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:15 devstack sudo[92858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6cf7a489-3800-4f24-895d-e864162db302 1073741824 Jul 07 17:23:15 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:15 devstack sudo[92857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.3937414d-7ade-43bd-a7c0-ec28d9fa978f Jul 07 17:23:15 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:15 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e57bebb9-cf16-4a00-b6be-652d862e91c9 tempest-SnapshotsActionsTest-286588036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.3937414d-7ade-43bd-a7c0-ec28d9fa978f" returned: 0 in 0.983s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e57bebb9-cf16-4a00-b6be-652d862e91c9 tempest-SnapshotsActionsTest-286588036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:23:16 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e00e6bf-7d86-4d67-a229-d0612e480410]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e57bebb9-cf16-4a00-b6be-652d862e91c9 tempest-SnapshotsActionsTest-286588036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:16 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6cf7a489-3800-4f24-895d-e864162db302 1073741824" returned: 0 in 1.065s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6cf7a489-3800-4f24-895d-e864162db302 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:16 devstack sudo[92868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 Jul 07 17:23:16 devstack sudo[92868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:16 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6cf7a489-3800-4f24-895d-e864162db302 Jul 07 17:23:16 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:17 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6cf7a489-3800-4f24-895d-e864162db302" returned: 0 in 0.951s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:23:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebce59f0-280a-42f1-ba8e-5ee91d9db12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cf7a489-3800-4f24-895d-e864162db302', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19fd0092-1951-42ee-a811-66f2d749cfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:17 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Volume volume-6cf7a489-3800-4f24-895d-e864162db302 (6cf7a489-3800-4f24-895d-e864162db302): created successfully Jul 07 17:23:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19fd0092-1951-42ee-a811-66f2d749cfda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Flow 'volume_create_manager' (5e6c174c-1006-445c-a4ab-187bcbfe13b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:23:17 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-63cbf587-1738-4883-ab7f-112aeb4391ff tempest-VolumesTransfersV355Test-1143688279 None] Created volume successfully. Jul 07 17:23:17 devstack sudo[92868]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e57bebb9-cf16-4a00-b6be-652d862e91c9 tempest-SnapshotsActionsTest-286588036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7" returned: 0 in 1.269s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e57bebb9-cf16-4a00-b6be-652d862e91c9 tempest-SnapshotsActionsTest-286588036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:23:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e57bebb9-cf16-4a00-b6be-652d862e91c9 tempest-SnapshotsActionsTest-286588036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.3937414d-7ade-43bd-a7c0-ec28d9fa978f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:17 devstack sudo[92912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.3937414d-7ade-43bd-a7c0-ec28d9fa978f Jul 07 17:23:17 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:18 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e57bebb9-cf16-4a00-b6be-652d862e91c9 tempest-SnapshotsActionsTest-286588036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.3937414d-7ade-43bd-a7c0-ec28d9fa978f" returned: 0 in 1.012s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e57bebb9-cf16-4a00-b6be-652d862e91c9 tempest-SnapshotsActionsTest-286588036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.3937414d-7ade-43bd-a7c0-ec28d9fa978f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:18 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.3937414d-7ade-43bd-a7c0-ec28d9fa978f Jul 07 17:23:18 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:19 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e57bebb9-cf16-4a00-b6be-652d862e91c9 tempest-SnapshotsActionsTest-286588036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.3937414d-7ade-43bd-a7c0-ec28d9fa978f" returned: 0 in 1.063s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:19 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-d318fc3d-f839-4347-856e-722df7b30db6 tempest-VolumesTransfersV355Test-1957365833 None] Transfer volume completed successfully. Jul 07 17:23:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e57bebb9-cf16-4a00-b6be-652d862e91c9 tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-quobyte-3937414d-7ade-43bd-a7c0-ec28d9fa978f" released by "_delete_snapshot" :: held 4.550s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e57bebb9-cf16-4a00-b6be-652d862e91c9 tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-quobyte-1d52b2f3-cba6-4075-bdbf-85b6b66f0264" released by "delete_snapshot" :: held 4.589s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:19 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-e57bebb9-cf16-4a00-b6be-652d862e91c9 tempest-SnapshotsActionsTest-286588036 None] Created reservations ['f6823453-0844-4921-b2aa-348e4662bf26', '2ebd321b-7e92-484b-a8bc-e2d60fa71d4c', '2564dab8-9f91-48ed-af84-8db520f8f55e', 'f3fa31e9-332b-41f1-ae65-52ba15aa287e'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:19 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-e57bebb9-cf16-4a00-b6be-652d862e91c9 tempest-SnapshotsActionsTest-286588036 None] Delete snapshot completed successfully. Jul 07 17:23:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e57bebb9-cf16-4a00-b6be-652d862e91c9 tempest-SnapshotsActionsTest-286588036 None] Lock "cinder-3937414d-7ade-43bd-a7c0-ec28d9fa978f-delete_snapshot" released by "delete_snapshot" :: held 4.788s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-21177ef6-16a4-49c7-b5da-4541b2a32018 tempest-VolumesTransfersV355Test-1617983213 None] Acquiring lock "cinder-6cf7a489-3800-4f24-895d-e864162db302-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-21177ef6-16a4-49c7-b5da-4541b2a32018 tempest-VolumesTransfersV355Test-1617983213 None] Lock "cinder-6cf7a489-3800-4f24-895d-e864162db302-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-21177ef6-16a4-49c7-b5da-4541b2a32018 tempest-VolumesTransfersV355Test-1617983213 None] Acquiring lock "cinder-quobyte-6cf7a489-3800-4f24-895d-e864162db302" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-21177ef6-16a4-49c7-b5da-4541b2a32018 tempest-VolumesTransfersV355Test-1617983213 None] Lock "cinder-quobyte-6cf7a489-3800-4f24-895d-e864162db302" acquired by "delete_volume" :: waited 0.020s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:20 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fa974f-b754-4ae9-955e-19b9e46c700d]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-21177ef6-16a4-49c7-b5da-4541b2a32018 tempest-VolumesTransfersV355Test-1617983213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6cf7a489-3800-4f24-895d-e864162db302 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:20 devstack sudo[93335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6cf7a489-3800-4f24-895d-e864162db302 Jul 07 17:23:20 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e0807486-f346-49e3-9210-62d72f4d7069 tempest-SnapshotsActionsTest-529068948 None] Acquiring lock "cinder-d0b18aa5-2fb1-4216-9a35-9f26648907b7-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e0807486-f346-49e3-9210-62d72f4d7069 tempest-SnapshotsActionsTest-529068948 None] Lock "cinder-d0b18aa5-2fb1-4216-9a35-9f26648907b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e0807486-f346-49e3-9210-62d72f4d7069 tempest-SnapshotsActionsTest-529068948 None] Acquiring lock "cinder-quobyte-1d52b2f3-cba6-4075-bdbf-85b6b66f0264" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e0807486-f346-49e3-9210-62d72f4d7069 tempest-SnapshotsActionsTest-529068948 None] Lock "cinder-quobyte-1d52b2f3-cba6-4075-bdbf-85b6b66f0264" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e0807486-f346-49e3-9210-62d72f4d7069 tempest-SnapshotsActionsTest-529068948 None] Acquiring lock "cinder-quobyte-d0b18aa5-2fb1-4216-9a35-9f26648907b7" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e0807486-f346-49e3-9210-62d72f4d7069 tempest-SnapshotsActionsTest-529068948 None] Lock "cinder-quobyte-d0b18aa5-2fb1-4216-9a35-9f26648907b7" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e0807486-f346-49e3-9210-62d72f4d7069 tempest-SnapshotsActionsTest-529068948 None] Deleting offline snapshot d0b18aa5-2fb1-4216-9a35-9f26648907b7 of volume 1d52b2f3-cba6-4075-bdbf-85b6b66f0264 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:23:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e0807486-f346-49e3-9210-62d72f4d7069 tempest-SnapshotsActionsTest-529068948 None] snapshot_file for this snap is: volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:23:21 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcb58de-ce03-4191-b408-12bc35c4dcb2]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e0807486-f346-49e3-9210-62d72f4d7069 tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:21 devstack sudo[93349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 Jul 07 17:23:21 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:21 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-21177ef6-16a4-49c7-b5da-4541b2a32018 tempest-VolumesTransfersV355Test-1617983213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6cf7a489-3800-4f24-895d-e864162db302" returned: 0 in 1.064s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-21177ef6-16a4-49c7-b5da-4541b2a32018 tempest-VolumesTransfersV355Test-1617983213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6cf7a489-3800-4f24-895d-e864162db302 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:21 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6cf7a489-3800-4f24-895d-e864162db302 Jul 07 17:23:21 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:22 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e0807486-f346-49e3-9210-62d72f4d7069 tempest-SnapshotsActionsTest-529068948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7" returned: 0 in 1.032s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e0807486-f346-49e3-9210-62d72f4d7069 tempest-SnapshotsActionsTest-529068948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:23:22 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[001e8a47-9c18-4ce4-af39-17721c743ecc]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e0807486-f346-49e3-9210-62d72f4d7069 tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:22 devstack sudo[93361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264 Jul 07 17:23:22 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:22 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-21177ef6-16a4-49c7-b5da-4541b2a32018 tempest-VolumesTransfersV355Test-1617983213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6cf7a489-3800-4f24-895d-e864162db302" returned: 0 in 0.949s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:22 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-21177ef6-16a4-49c7-b5da-4541b2a32018 tempest-VolumesTransfersV355Test-1617983213 None] Lock "cinder-quobyte-6cf7a489-3800-4f24-895d-e864162db302" released by "delete_volume" :: held 2.097s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:22 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-21177ef6-16a4-49c7-b5da-4541b2a32018 tempest-VolumesTransfersV355Test-1617983213 None] Created reservations ['329d2bf8-ff3f-4a8a-99c3-4f1f2783dffb', 'ca84040b-b55d-44a3-9bfb-91371283b415', '529bf331-e0e0-44f4-9c78-cea196ca217d', 'fad5927a-ee69-4a31-99a6-26ddde571e27'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-21177ef6-16a4-49c7-b5da-4541b2a32018 tempest-VolumesTransfersV355Test-1617983213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-21177ef6-16a4-49c7-b5da-4541b2a32018 tempest-VolumesTransfersV355Test-1617983213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-21177ef6-16a4-49c7-b5da-4541b2a32018 tempest-VolumesTransfersV355Test-1617983213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-21177ef6-16a4-49c7-b5da-4541b2a32018 tempest-VolumesTransfersV355Test-1617983213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-21177ef6-16a4-49c7-b5da-4541b2a32018 tempest-VolumesTransfersV355Test-1617983213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-21177ef6-16a4-49c7-b5da-4541b2a32018 tempest-VolumesTransfersV355Test-1617983213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:22 devstack sudo[93364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:23:22 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:23 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e0807486-f346-49e3-9210-62d72f4d7069 tempest-SnapshotsActionsTest-529068948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264" returned: 0 in 1.017s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e0807486-f346-49e3-9210-62d72f4d7069 tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:23 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 Jul 07 17:23:23 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:23 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-21177ef6-16a4-49c7-b5da-4541b2a32018 tempest-VolumesTransfersV355Test-1617983213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.194s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:24 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-21177ef6-16a4-49c7-b5da-4541b2a32018 tempest-VolumesTransfersV355Test-1617983213 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:23:24 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-21177ef6-16a4-49c7-b5da-4541b2a32018 tempest-VolumesTransfersV355Test-1617983213 None] Deleted volume successfully. Jul 07 17:23:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-21177ef6-16a4-49c7-b5da-4541b2a32018 tempest-VolumesTransfersV355Test-1617983213 None] Lock "cinder-6cf7a489-3800-4f24-895d-e864162db302-delete_volume" released by "delete_volume" :: held 3.629s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:24 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e0807486-f346-49e3-9210-62d72f4d7069 tempest-SnapshotsActionsTest-529068948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7" returned: 0 in 1.461s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e0807486-f346-49e3-9210-62d72f4d7069 tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:24 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7 Jul 07 17:23:24 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-15b0eb40-0c55-4862-8cd8-3c04ef4d9ce8 tempest-AttachVolumeTestJSON-285176547 None] Acquiring lock "cinder-9c0146dd-7357-4309-849b-e3d4858c0123-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-15b0eb40-0c55-4862-8cd8-3c04ef4d9ce8 tempest-AttachVolumeTestJSON-285176547 None] Lock "cinder-9c0146dd-7357-4309-849b-e3d4858c0123-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:24 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:23:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Flow 'volume_create_manager' (c81b9699-a597-41e6-abfb-7affe2b8a850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:23:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b24bf4d-1450-4260-a291-ec7b2f9a72dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-15b0eb40-0c55-4862-8cd8-3c04ef4d9ce8 tempest-AttachVolumeTestJSON-285176547 None] Acquiring lock "cinder-quobyte-9c0146dd-7357-4309-849b-e3d4858c0123" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b24bf4d-1450-4260-a291-ec7b2f9a72dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-193641156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d87ade9-74f0-4872-b3c1-16654a493627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8ee460382724c13acb84b50498c7c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:25Z,use_quota=True,user_id='4dafb3cd77ae47629849f4375e315926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3171c88e-be39-4c4f-a7c2-b3c9dcde6008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3171c88e-be39-4c4f-a7c2-b3c9dcde6008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6898b0d2-a0a8-453a-aeb8-6f011357edc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6898b0d2-a0a8-453a-aeb8-6f011357edc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d87ade9-74f0-4872-b3c1-16654a493627', 'volume_name': 'volume-9d87ade9-74f0-4872-b3c1-16654a493627', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e743e86a-8b76-4f06-a93b-37e4b635ddaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e743e86a-8b76-4f06-a93b-37e4b635ddaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05392ae8-f441-4de7-9437-6e2603313f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:25 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Volume 9d87ade9-74f0-4872-b3c1-16654a493627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d87ade9-74f0-4872-b3c1-16654a493627', 'volume_size': 1} Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-193641156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d87ade9-74f0-4872-b3c1-16654a493627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8ee460382724c13acb84b50498c7c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:25Z,use_quota=True,user_id='4dafb3cd77ae47629849f4375e315926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Creating volume 9d87ade9-74f0-4872-b3c1-16654a493627 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:23:25 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d87ade9-74f0-4872-b3c1-16654a493627 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-15b0eb40-0c55-4862-8cd8-3c04ef4d9ce8 tempest-AttachVolumeTestJSON-285176547 None] Lock "cinder-quobyte-9c0146dd-7357-4309-849b-e3d4858c0123" acquired by "delete_volume" :: waited 0.089s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:25 devstack sudo[93378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d87ade9-74f0-4872-b3c1-16654a493627 1073741824 Jul 07 17:23:25 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a76a5a7-2db3-449e-badf-9cb046aab23b]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-15b0eb40-0c55-4862-8cd8-3c04ef4d9ce8 tempest-AttachVolumeTestJSON-285176547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9c0146dd-7357-4309-849b-e3d4858c0123 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:25 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9c0146dd-7357-4309-849b-e3d4858c0123 Jul 07 17:23:25 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:25 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e0807486-f346-49e3-9210-62d72f4d7069 tempest-SnapshotsActionsTest-529068948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264.d0b18aa5-2fb1-4216-9a35-9f26648907b7" returned: 0 in 0.986s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e0807486-f346-49e3-9210-62d72f4d7069 tempest-SnapshotsActionsTest-529068948 None] Lock "cinder-quobyte-d0b18aa5-2fb1-4216-9a35-9f26648907b7" released by "_delete_snapshot" :: held 4.672s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e0807486-f346-49e3-9210-62d72f4d7069 tempest-SnapshotsActionsTest-529068948 None] Lock "cinder-quobyte-1d52b2f3-cba6-4075-bdbf-85b6b66f0264" released by "delete_snapshot" :: held 4.715s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-e0807486-f346-49e3-9210-62d72f4d7069 tempest-SnapshotsActionsTest-529068948 None] Created reservations ['16286c51-2a41-4868-aad4-aea64643eaf5', '6934d228-9401-42ee-89ff-cfda04960220', '1ee331c7-095b-41a7-8c71-205a9797cac8', '261151f0-3662-45bc-9fac-6bf493504cb4'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:25 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-e0807486-f346-49e3-9210-62d72f4d7069 tempest-SnapshotsActionsTest-529068948 None] Delete snapshot completed successfully. Jul 07 17:23:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e0807486-f346-49e3-9210-62d72f4d7069 tempest-SnapshotsActionsTest-529068948 None] Lock "cinder-d0b18aa5-2fb1-4216-9a35-9f26648907b7-delete_snapshot" released by "delete_snapshot" :: held 4.908s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:26 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-15b0eb40-0c55-4862-8cd8-3c04ef4d9ce8 tempest-AttachVolumeTestJSON-285176547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9c0146dd-7357-4309-849b-e3d4858c0123" returned: 0 in 0.950s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-15b0eb40-0c55-4862-8cd8-3c04ef4d9ce8 tempest-AttachVolumeTestJSON-285176547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9c0146dd-7357-4309-849b-e3d4858c0123 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:26 devstack sudo[93390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9c0146dd-7357-4309-849b-e3d4858c0123 Jul 07 17:23:26 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:26 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d87ade9-74f0-4872-b3c1-16654a493627 1073741824" returned: 0 in 1.096s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d87ade9-74f0-4872-b3c1-16654a493627 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:26 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d87ade9-74f0-4872-b3c1-16654a493627 Jul 07 17:23:26 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-94d7fd96-0568-474d-8979-c922f1cdf75a tempest-SnapshotsActionsTest-529068948 None] Acquiring lock "cinder-1d52b2f3-cba6-4075-bdbf-85b6b66f0264-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-94d7fd96-0568-474d-8979-c922f1cdf75a tempest-SnapshotsActionsTest-529068948 None] Lock "cinder-1d52b2f3-cba6-4075-bdbf-85b6b66f0264-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-94d7fd96-0568-474d-8979-c922f1cdf75a tempest-SnapshotsActionsTest-529068948 None] Acquiring lock "cinder-quobyte-1d52b2f3-cba6-4075-bdbf-85b6b66f0264" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-94d7fd96-0568-474d-8979-c922f1cdf75a tempest-SnapshotsActionsTest-529068948 None] Lock "cinder-quobyte-1d52b2f3-cba6-4075-bdbf-85b6b66f0264" acquired by "delete_volume" :: waited 0.024s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:26 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5ed157-3ce0-42a5-8cba-bb902b02ee96]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-94d7fd96-0568-474d-8979-c922f1cdf75a tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:26 devstack sudo[93394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264 Jul 07 17:23:26 devstack sudo[93394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:26 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-15b0eb40-0c55-4862-8cd8-3c04ef4d9ce8 tempest-AttachVolumeTestJSON-285176547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9c0146dd-7357-4309-849b-e3d4858c0123" returned: 0 in 0.859s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-15b0eb40-0c55-4862-8cd8-3c04ef4d9ce8 tempest-AttachVolumeTestJSON-285176547 None] Lock "cinder-quobyte-9c0146dd-7357-4309-849b-e3d4858c0123" released by "delete_volume" :: held 1.867s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:27 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-15b0eb40-0c55-4862-8cd8-3c04ef4d9ce8 tempest-AttachVolumeTestJSON-285176547 None] Created reservations ['27d4ca7d-5a93-4a75-b81d-439eb06f34e1', '2afe3c25-9fac-4210-8613-e45e30aa825d', '2d53cdd2-add9-458a-b86c-7fb73b505ad7', '997ea1fc-4c8a-4050-ac84-2aa56b24d397'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:27 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d87ade9-74f0-4872-b3c1-16654a493627" returned: 0 in 1.011s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] <== create_volume: return (2161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:23:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.164s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:27 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05392ae8-f441-4de7-9437-6e2603313f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d87ade9-74f0-4872-b3c1-16654a493627', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:27 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3942e2e6-b9c8-499a-88cf-bb8d21d8aab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:27 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Volume volume-9d87ade9-74f0-4872-b3c1-16654a493627 (9d87ade9-74f0-4872-b3c1-16654a493627): created successfully Jul 07 17:23:27 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3942e2e6-b9c8-499a-88cf-bb8d21d8aab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:27 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Flow 'volume_create_manager' (c81b9699-a597-41e6-abfb-7affe2b8a850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:23:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-15b0eb40-0c55-4862-8cd8-3c04ef4d9ce8 tempest-AttachVolumeTestJSON-285176547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-15b0eb40-0c55-4862-8cd8-3c04ef4d9ce8 tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-15b0eb40-0c55-4862-8cd8-3c04ef4d9ce8 tempest-AttachVolumeTestJSON-285176547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-15b0eb40-0c55-4862-8cd8-3c04ef4d9ce8 tempest-AttachVolumeTestJSON-285176547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-15b0eb40-0c55-4862-8cd8-3c04ef4d9ce8 tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-15b0eb40-0c55-4862-8cd8-3c04ef4d9ce8 tempest-AttachVolumeTestJSON-285176547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:27 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-3e939533-dbdf-4672-9b36-04df70da753e tempest-VolumesTransfersV355Test-1143688279 None] Created volume successfully. Jul 07 17:23:27 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:23:27 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:27 devstack sudo[93394]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-94d7fd96-0568-474d-8979-c922f1cdf75a tempest-SnapshotsActionsTest-529068948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264" returned: 0 in 0.957s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-94d7fd96-0568-474d-8979-c922f1cdf75a tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:27 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264 Jul 07 17:23:27 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:28 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-15b0eb40-0c55-4862-8cd8-3c04ef4d9ce8 tempest-AttachVolumeTestJSON-285176547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.862s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-15b0eb40-0c55-4862-8cd8-3c04ef4d9ce8 tempest-AttachVolumeTestJSON-285176547 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:23:28 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-15b0eb40-0c55-4862-8cd8-3c04ef4d9ce8 tempest-AttachVolumeTestJSON-285176547 None] Deleted volume successfully. Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-15b0eb40-0c55-4862-8cd8-3c04ef4d9ce8 tempest-AttachVolumeTestJSON-285176547 None] Lock "cinder-9c0146dd-7357-4309-849b-e3d4858c0123-delete_volume" released by "delete_volume" :: held 3.348s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:28 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-94d7fd96-0568-474d-8979-c922f1cdf75a tempest-SnapshotsActionsTest-529068948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1d52b2f3-cba6-4075-bdbf-85b6b66f0264" returned: 0 in 0.768s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-3652f911-aabe-4799-85b4-2d1f1764093a tempest-AttachVolumeTestJSON-285176547 None] Acquiring lock "cinder-25b28e4c-0c3a-45b1-995e-59b1843cb329-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-94d7fd96-0568-474d-8979-c922f1cdf75a tempest-SnapshotsActionsTest-529068948 None] Lock "cinder-quobyte-1d52b2f3-cba6-4075-bdbf-85b6b66f0264" released by "delete_volume" :: held 1.803s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-3652f911-aabe-4799-85b4-2d1f1764093a tempest-AttachVolumeTestJSON-285176547 None] Lock "cinder-25b28e4c-0c3a-45b1-995e-59b1843cb329-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-3652f911-aabe-4799-85b4-2d1f1764093a tempest-AttachVolumeTestJSON-285176547 None] Acquiring lock "cinder-quobyte-25b28e4c-0c3a-45b1-995e-59b1843cb329" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-94d7fd96-0568-474d-8979-c922f1cdf75a tempest-SnapshotsActionsTest-529068948 None] Created reservations ['1200817a-2fc9-4ace-915d-9c567531906e', '5d45da7d-5dc5-41c7-8884-f30f0717fc6e', 'b4f32a5b-c924-410f-919d-4194e4e4117c', '229f4410-18f6-49c8-9e56-13f1e01db858'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-3652f911-aabe-4799-85b4-2d1f1764093a tempest-AttachVolumeTestJSON-285176547 None] Lock "cinder-quobyte-25b28e4c-0c3a-45b1-995e-59b1843cb329" acquired by "delete_volume" :: waited 0.039s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2a4134-1da4-4789-9de0-b045157395e8]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3652f911-aabe-4799-85b4-2d1f1764093a tempest-AttachVolumeTestJSON-285176547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-25b28e4c-0c3a-45b1-995e-59b1843cb329 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-94d7fd96-0568-474d-8979-c922f1cdf75a tempest-SnapshotsActionsTest-529068948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-94d7fd96-0568-474d-8979-c922f1cdf75a tempest-SnapshotsActionsTest-529068948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-94d7fd96-0568-474d-8979-c922f1cdf75a tempest-SnapshotsActionsTest-529068948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-94d7fd96-0568-474d-8979-c922f1cdf75a tempest-SnapshotsActionsTest-529068948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-94d7fd96-0568-474d-8979-c922f1cdf75a tempest-SnapshotsActionsTest-529068948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-94d7fd96-0568-474d-8979-c922f1cdf75a tempest-SnapshotsActionsTest-529068948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-476efc10-5341-45a3-9ea7-a68865812d84 tempest-VolumesTransfersV355Test-1617983213 None] Acquiring lock "cinder-9d87ade9-74f0-4872-b3c1-16654a493627-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:28 devstack sudo[93408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:23:28 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-476efc10-5341-45a3-9ea7-a68865812d84 tempest-VolumesTransfersV355Test-1617983213 None] Lock "cinder-9d87ade9-74f0-4872-b3c1-16654a493627-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:28 devstack sudo[93407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-25b28e4c-0c3a-45b1-995e-59b1843cb329 Jul 07 17:23:28 devstack sudo[93407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-476efc10-5341-45a3-9ea7-a68865812d84 tempest-VolumesTransfersV355Test-1617983213 None] Acquiring lock "cinder-quobyte-9d87ade9-74f0-4872-b3c1-16654a493627" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-476efc10-5341-45a3-9ea7-a68865812d84 tempest-VolumesTransfersV355Test-1617983213 None] Lock "cinder-quobyte-9d87ade9-74f0-4872-b3c1-16654a493627" acquired by "delete_volume" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f6f86b-fbf5-4505-9b7f-baffcb7b162f]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-476efc10-5341-45a3-9ea7-a68865812d84 tempest-VolumesTransfersV355Test-1617983213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d87ade9-74f0-4872-b3c1-16654a493627 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:29 devstack sudo[93411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d87ade9-74f0-4872-b3c1-16654a493627 Jul 07 17:23:29 devstack sudo[93411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:29 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:29 devstack sudo[93407]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-94d7fd96-0568-474d-8979-c922f1cdf75a tempest-SnapshotsActionsTest-529068948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.266s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:29 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-94d7fd96-0568-474d-8979-c922f1cdf75a tempest-SnapshotsActionsTest-529068948 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:23:29 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-94d7fd96-0568-474d-8979-c922f1cdf75a tempest-SnapshotsActionsTest-529068948 None] Deleted volume successfully. Jul 07 17:23:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3652f911-aabe-4799-85b4-2d1f1764093a tempest-AttachVolumeTestJSON-285176547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-25b28e4c-0c3a-45b1-995e-59b1843cb329" returned: 0 in 1.399s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3652f911-aabe-4799-85b4-2d1f1764093a tempest-AttachVolumeTestJSON-285176547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-25b28e4c-0c3a-45b1-995e-59b1843cb329 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-94d7fd96-0568-474d-8979-c922f1cdf75a tempest-SnapshotsActionsTest-529068948 None] Lock "cinder-1d52b2f3-cba6-4075-bdbf-85b6b66f0264-delete_volume" released by "delete_volume" :: held 3.529s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:30 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-25b28e4c-0c3a-45b1-995e-59b1843cb329 Jul 07 17:23:30 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:30 devstack sudo[93411]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-476efc10-5341-45a3-9ea7-a68865812d84 tempest-VolumesTransfersV355Test-1617983213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d87ade9-74f0-4872-b3c1-16654a493627" returned: 0 in 1.419s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-476efc10-5341-45a3-9ea7-a68865812d84 tempest-VolumesTransfersV355Test-1617983213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d87ade9-74f0-4872-b3c1-16654a493627 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:30 devstack sudo[93423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d87ade9-74f0-4872-b3c1-16654a493627 Jul 07 17:23:30 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:30 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3652f911-aabe-4799-85b4-2d1f1764093a tempest-AttachVolumeTestJSON-285176547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-25b28e4c-0c3a-45b1-995e-59b1843cb329" returned: 0 in 0.911s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-3652f911-aabe-4799-85b4-2d1f1764093a tempest-AttachVolumeTestJSON-285176547 None] Lock "cinder-quobyte-25b28e4c-0c3a-45b1-995e-59b1843cb329" released by "delete_volume" :: held 2.374s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:30 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-3652f911-aabe-4799-85b4-2d1f1764093a tempest-AttachVolumeTestJSON-285176547 None] Created reservations ['b9603245-e888-431f-b8e8-d937dbdae338', 'c9d19d52-583b-4603-8894-bb2dd570d783', 'cd7eb79c-e382-4f39-b4a3-4da4ac7446f5', '750cd1ab-c949-44a7-954b-89b74fb588cb'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3652f911-aabe-4799-85b4-2d1f1764093a tempest-AttachVolumeTestJSON-285176547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3652f911-aabe-4799-85b4-2d1f1764093a tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3652f911-aabe-4799-85b4-2d1f1764093a tempest-AttachVolumeTestJSON-285176547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3652f911-aabe-4799-85b4-2d1f1764093a tempest-AttachVolumeTestJSON-285176547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3652f911-aabe-4799-85b4-2d1f1764093a tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3652f911-aabe-4799-85b4-2d1f1764093a tempest-AttachVolumeTestJSON-285176547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:31 devstack sudo[93427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:23:31 devstack sudo[93427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:31 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-476efc10-5341-45a3-9ea7-a68865812d84 tempest-VolumesTransfersV355Test-1617983213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d87ade9-74f0-4872-b3c1-16654a493627" returned: 0 in 0.972s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-476efc10-5341-45a3-9ea7-a68865812d84 tempest-VolumesTransfersV355Test-1617983213 None] Lock "cinder-quobyte-9d87ade9-74f0-4872-b3c1-16654a493627" released by "delete_volume" :: held 2.497s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:31 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-476efc10-5341-45a3-9ea7-a68865812d84 tempest-VolumesTransfersV355Test-1617983213 None] Created reservations ['c087e561-6d6a-4d62-96b8-48a54fec033c', 'd1b4ab74-4074-4ff9-9a54-fd78f2786a46', 'b8edc1e0-3987-4f58-ad86-ef3eea040a38', '7ad5abff-0746-4b03-92b4-6ae47e5e2b8d'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-476efc10-5341-45a3-9ea7-a68865812d84 tempest-VolumesTransfersV355Test-1617983213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-476efc10-5341-45a3-9ea7-a68865812d84 tempest-VolumesTransfersV355Test-1617983213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-476efc10-5341-45a3-9ea7-a68865812d84 tempest-VolumesTransfersV355Test-1617983213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-476efc10-5341-45a3-9ea7-a68865812d84 tempest-VolumesTransfersV355Test-1617983213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-476efc10-5341-45a3-9ea7-a68865812d84 tempest-VolumesTransfersV355Test-1617983213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-476efc10-5341-45a3-9ea7-a68865812d84 tempest-VolumesTransfersV355Test-1617983213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:31 devstack sudo[93430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:23:31 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:32 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-edabeeab-69ba-49eb-933a-92a055ff776e tempest-AttachVolumeTestJSON-285176547 None] Acquiring lock "cinder-a84d32bd-1ed2-442a-aeb9-1cd9023c283b-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:32 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-edabeeab-69ba-49eb-933a-92a055ff776e tempest-AttachVolumeTestJSON-285176547 None] Lock "cinder-a84d32bd-1ed2-442a-aeb9-1cd9023c283b-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:32 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-edabeeab-69ba-49eb-933a-92a055ff776e tempest-AttachVolumeTestJSON-285176547 None] Acquiring lock "cinder-quobyte-a84d32bd-1ed2-442a-aeb9-1cd9023c283b" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:23:32 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-edabeeab-69ba-49eb-933a-92a055ff776e tempest-AttachVolumeTestJSON-285176547 None] Lock "cinder-quobyte-a84d32bd-1ed2-442a-aeb9-1cd9023c283b" acquired by "delete_volume" :: waited 0.040s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:23:32 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[550c4313-3252-4808-8467-8fe9fec601f6]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-edabeeab-69ba-49eb-933a-92a055ff776e tempest-AttachVolumeTestJSON-285176547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a84d32bd-1ed2-442a-aeb9-1cd9023c283b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:32 devstack sudo[93432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a84d32bd-1ed2-442a-aeb9-1cd9023c283b Jul 07 17:23:32 devstack sudo[93432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:32 devstack sudo[93427]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3652f911-aabe-4799-85b4-2d1f1764093a tempest-AttachVolumeTestJSON-285176547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.660s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:32 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-3652f911-aabe-4799-85b4-2d1f1764093a tempest-AttachVolumeTestJSON-285176547 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:23:32 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-3652f911-aabe-4799-85b4-2d1f1764093a tempest-AttachVolumeTestJSON-285176547 None] Deleted volume successfully. Jul 07 17:23:32 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-3652f911-aabe-4799-85b4-2d1f1764093a tempest-AttachVolumeTestJSON-285176547 None] Lock "cinder-25b28e4c-0c3a-45b1-995e-59b1843cb329-delete_volume" released by "delete_volume" :: held 4.455s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:33 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-476efc10-5341-45a3-9ea7-a68865812d84 tempest-VolumesTransfersV355Test-1617983213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.667s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:33 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-476efc10-5341-45a3-9ea7-a68865812d84 tempest-VolumesTransfersV355Test-1617983213 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:23:33 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-476efc10-5341-45a3-9ea7-a68865812d84 tempest-VolumesTransfersV355Test-1617983213 None] Deleted volume successfully. Jul 07 17:23:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-476efc10-5341-45a3-9ea7-a68865812d84 tempest-VolumesTransfersV355Test-1617983213 None] Lock "cinder-9d87ade9-74f0-4872-b3c1-16654a493627-delete_volume" released by "delete_volume" :: held 4.575s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:33 devstack sudo[93432]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-edabeeab-69ba-49eb-933a-92a055ff776e tempest-AttachVolumeTestJSON-285176547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a84d32bd-1ed2-442a-aeb9-1cd9023c283b" returned: 0 in 1.540s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-edabeeab-69ba-49eb-933a-92a055ff776e tempest-AttachVolumeTestJSON-285176547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a84d32bd-1ed2-442a-aeb9-1cd9023c283b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:33 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a84d32bd-1ed2-442a-aeb9-1cd9023c283b Jul 07 17:23:33 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:34 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-edabeeab-69ba-49eb-933a-92a055ff776e tempest-AttachVolumeTestJSON-285176547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a84d32bd-1ed2-442a-aeb9-1cd9023c283b" returned: 0 in 1.070s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-edabeeab-69ba-49eb-933a-92a055ff776e tempest-AttachVolumeTestJSON-285176547 None] Lock "cinder-quobyte-a84d32bd-1ed2-442a-aeb9-1cd9023c283b" released by "delete_volume" :: held 2.689s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:35 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-edabeeab-69ba-49eb-933a-92a055ff776e tempest-AttachVolumeTestJSON-285176547 None] Created reservations ['ad14d981-2bc0-4722-bdd8-fba55a72ad08', 'b891f514-69bc-43fe-a3d1-9e80a3685c01', '0f9cf100-c519-45b1-aae6-46d0e5ba1535', '0c52d509-b51e-4cdc-af26-88a5a2f87bdd'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:23:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-edabeeab-69ba-49eb-933a-92a055ff776e tempest-AttachVolumeTestJSON-285176547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-edabeeab-69ba-49eb-933a-92a055ff776e tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:35 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-edabeeab-69ba-49eb-933a-92a055ff776e tempest-AttachVolumeTestJSON-285176547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:35 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-edabeeab-69ba-49eb-933a-92a055ff776e tempest-AttachVolumeTestJSON-285176547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-edabeeab-69ba-49eb-933a-92a055ff776e tempest-AttachVolumeTestJSON-285176547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-edabeeab-69ba-49eb-933a-92a055ff776e tempest-AttachVolumeTestJSON-285176547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:35 devstack sudo[93472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:23:35 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:36 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-edabeeab-69ba-49eb-933a-92a055ff776e tempest-AttachVolumeTestJSON-285176547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.208s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:36 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-edabeeab-69ba-49eb-933a-92a055ff776e tempest-AttachVolumeTestJSON-285176547 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:23:36 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-edabeeab-69ba-49eb-933a-92a055ff776e tempest-AttachVolumeTestJSON-285176547 None] Deleted volume successfully. Jul 07 17:23:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-edabeeab-69ba-49eb-933a-92a055ff776e tempest-AttachVolumeTestJSON-285176547 None] Lock "cinder-a84d32bd-1ed2-442a-aeb9-1cd9023c283b-delete_volume" released by "delete_volume" :: held 4.381s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:23:41 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:23:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Flow 'volume_create_manager' (4e939d99-c96b-4777-bd65-1f54c1b0cee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:23:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78436a93-728d-494a-b02d-4f5f46d8e0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78436a93-728d-494a-b02d-4f5f46d8e0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2042985395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e552da-2d23-47c0-a879-626f808b1b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f20af55aff7241b794c30a3d6e91cc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:41Z,use_quota=True,user_id='0aa8817bab6a463a9acdc88a25956444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbbec77c-f992-4bc3-9713-4cf244f9f2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbbec77c-f992-4bc3-9713-4cf244f9f2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd2bac9-213b-4658-89e7-66a58e069825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:41 devstack cinder-volume[87303]: DEBUG cinder.image.glance [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Creating Keystone auth plugin from conf {{(pid=87303) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:23:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd2bac9-213b-4658-89e7-66a58e069825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '96e552da-2d23-47c0-a879-626f808b1b06', 'volume_name': 'volume-96e552da-2d23-47c0-a879-626f808b1b06', 'volume_size': 1, 'image_id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '209334a192ee4ec7a4a563a01fc9db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/919a0971-57b8-4ecd-833d-de05e9b603e2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54d5131-bf05-4bea-a5c2-28da2820d9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54d5131-bf05-4bea-a5c2-28da2820d9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b9c11a3-6b51-456a-a94b-221b270d34aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:41 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Volume 96e552da-2d23-47c0-a879-626f808b1b06: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-96e552da-2d23-47c0-a879-626f808b1b06', 'volume_size': 1, 'image_id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '209334a192ee4ec7a4a563a01fc9db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/919a0971-57b8-4ecd-833d-de05e9b603e2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 17:23:41 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Trying to clone 96e552da-2d23-47c0-a879-626f808b1b06 from image 919a0971-57b8-4ecd-833d-de05e9b603e2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}]). {{(pid=87303) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:23:41 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_2c6nfne2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:23:41 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Image download 20.69 MB at 20.69 MB/s Jul 07 17:23:41 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[89736ec2-c38a-4ccb-8cdb-7b65de468cce]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_2c6nfne2devstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:42 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_2c6nfne2devstack@QuobyteHD Jul 07 17:23:42 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:42 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_2c6nfne2devstack@QuobyteHD" returned: 0 in 0.968s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:42 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Temporary image 919a0971-57b8-4ecd-833d-de05e9b603e2 is fetched for user 0aa8817bab6a463a9acdc88a25956444. {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:23:43 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0132e1-9b23-4b2d-8cd3-64556c57158d]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_2c6nfne2devstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:43 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_2c6nfne2devstack@QuobyteHD Jul 07 17:23:43 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:44 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_2c6nfne2devstack@QuobyteHD" returned: 0 in 0.942s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2042985395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e552da-2d23-47c0-a879-626f808b1b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f20af55aff7241b794c30a3d6e91cc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:23:41Z,use_quota=True,user_id='0aa8817bab6a463a9acdc88a25956444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:23:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Creating volume 96e552da-2d23-47c0-a879-626f808b1b06 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:23:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:23:44 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:23:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:44 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 1073741824 Jul 07 17:23:44 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:45 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 1073741824" returned: 0 in 1.453s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:45 devstack sudo[93560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 Jul 07 17:23:45 devstack sudo[93560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:46 devstack sudo[93560]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06" returned: 0 in 0.916s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] <== create_volume: return (2445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:23:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.449s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:46 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Attempting download of 919a0971-57b8-4ecd-833d-de05e9b603e2 ((None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}])) to volume 96e552da-2d23-47c0-a879-626f808b1b06. {{(pid=87303) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:23:46 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39e1b01-31d2-471e-a8e4-9a323eceb7af]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_0b6owncg {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:46 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_0b6owncg Jul 07 17:23:46 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:47 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_0b6owncg" returned: 0 in 0.888s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_0b6owncg {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:47 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_0b6owncg Jul 07 17:23:47 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:48 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_0b6owncg" returned: 1 in 0.904s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_0b6owncg' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:23:48 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd24295-57fc-4949-a7f9-ad397acc1bbb]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_2c6nfne2devstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:48 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_2c6nfne2devstack@QuobyteHD Jul 07 17:23:48 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:48 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-4ed46bdd-2221-4a31-9c1b-6182f6032180 req-7daecdc9-40c6-47bc-b89d-78268388170a tempest-ServerActionsTestOtherA-1941139839 None] Terminate volume connection completed successfully. Jul 07 17:23:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-4ed46bdd-2221-4a31-9c1b-6182f6032180 req-7daecdc9-40c6-47bc-b89d-78268388170a tempest-ServerActionsTestOtherA-1941139839 None] Deleting attachment 90902b6e-198c-4a27-a7ca-ed4c64c8bc1f. {{(pid=87303) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:23:49 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_2c6nfne2devstack@QuobyteHD" returned: 0 in 1.054s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:49 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] 919a0971-57b8-4ecd-833d-de05e9b603e2 was qcow2, converting to raw {{(pid=87303) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:23:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_2c6nfne2devstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:49 devstack sudo[93583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_2c6nfne2devstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 Jul 07 17:23:49 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:52 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_2c6nfne2devstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06" returned: 0 in 2.958s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:52 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_2c6nfne2devstack@QuobyteHD, size 112.00 MB, duration 2.96 sec, destination /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:23:52 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Converted 112.00 MB image at 37.84 MB/s Jul 07 17:23:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:52 devstack sudo[93594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 1G Jul 07 17:23:52 devstack sudo[93594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:53 devstack sudo[93594]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 1G" returned: 0 in 1.249s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:53 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60ec8eb-b403-4556-a337-a04d069f7498]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:53 devstack sudo[93627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 Jul 07 17:23:53 devstack sudo[93627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:54 devstack sudo[93627]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06" returned: 0 in 1.107s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:55 devstack sudo[93633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 Jul 07 17:23:55 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:55 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06" returned: 1 in 1.088s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:23:55 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Downloaded image 919a0971-57b8-4ecd-833d-de05e9b603e2 ((None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}])) to volume 96e552da-2d23-47c0-a879-626f808b1b06 successfully. {{(pid=87303) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:23:55 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Temporary image 919a0971-57b8-4ecd-833d-de05e9b603e2 for user 0aa8817bab6a463a9acdc88a25956444 is deleted. {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:23:55 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Marking volume 96e552da-2d23-47c0-a879-626f808b1b06 as bootable. {{(pid=87303) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:23:55 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Copying metadata from image 919a0971-57b8-4ecd-833d-de05e9b603e2 to 96e552da-2d23-47c0-a879-626f808b1b06. {{(pid=87303) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:23:55 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Creating volume glance metadata for volume 96e552da-2d23-47c0-a879-626f808b1b06 backed by image 919a0971-57b8-4ecd-833d-de05e9b603e2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87303) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:23:56 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b9c11a3-6b51-456a-a94b-221b270d34aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e552da-2d23-47c0-a879-626f808b1b06', 'volume_size': 1, 'image_id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '209334a192ee4ec7a4a563a01fc9db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/919a0971-57b8-4ecd-833d-de05e9b603e2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:56 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6837895f-c657-49d3-a3bd-2822415957fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:23:56 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Volume volume-96e552da-2d23-47c0-a879-626f808b1b06 (96e552da-2d23-47c0-a879-626f808b1b06): created successfully Jul 07 17:23:56 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6837895f-c657-49d3-a3bd-2822415957fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:23:56 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Flow 'volume_create_manager' (4e939d99-c96b-4777-bd65-1f54c1b0cee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:23:56 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-1c5795e0-797c-4c57-9128-d60aca8d6a71 tempest-VolumesExtendTest-1701032981 None] Created volume successfully. Jul 07 17:23:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-27f70eac-918c-4e7f-8314-bd525e4d688d tempest-VolumesExtendTest-1701032981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-27f70eac-918c-4e7f-8314-bd525e4d688d tempest-VolumesExtendTest-1701032981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:56 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a120fa-fd3b-432d-805a-a05a59293fb0]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:23:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-27f70eac-918c-4e7f-8314-bd525e4d688d tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:23:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:23:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:23:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:23:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:23:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:56 devstack sudo[93641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:23:56 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:56 devstack sudo[93640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 Jul 07 17:23:56 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:57 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.963s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:23:57 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:23:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:23:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:23:57 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-27f70eac-918c-4e7f-8314-bd525e4d688d tempest-VolumesExtendTest-1701032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06" returned: 0 in 1.212s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-27f70eac-918c-4e7f-8314-bd525e4d688d tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:57 devstack sudo[93648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 Jul 07 17:23:57 devstack sudo[93648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:23:58 devstack sudo[93648]: pam_unix(sudo:session): session closed for user root Jul 07 17:23:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-27f70eac-918c-4e7f-8314-bd525e4d688d tempest-VolumesExtendTest-1701032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06" returned: 1 in 1.119s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-27f70eac-918c-4e7f-8314-bd525e4d688d tempest-VolumesExtendTest-1701032981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:23:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-27f70eac-918c-4e7f-8314-bd525e4d688d tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 2G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:23:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-27f70eac-918c-4e7f-8314-bd525e4d688d tempest-VolumesExtendTest-1701032981 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 2G" returned: 0 in 0.133s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:23:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-27f70eac-918c-4e7f-8314-bd525e4d688d tempest-VolumesExtendTest-1701032981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.544s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:23:59 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-27f70eac-918c-4e7f-8314-bd525e4d688d tempest-VolumesExtendTest-1701032981 None] Extend volume completed successfully. Jul 07 17:24:00 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5b54fec7-08ff-4406-99c6-ba89b0cb76bd tempest-VolumesExtendTest-1701032981 None] Acquiring lock "cinder-96e552da-2d23-47c0-a879-626f808b1b06-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:00 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5b54fec7-08ff-4406-99c6-ba89b0cb76bd tempest-VolumesExtendTest-1701032981 None] Lock "cinder-96e552da-2d23-47c0-a879-626f808b1b06-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:00 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5b54fec7-08ff-4406-99c6-ba89b0cb76bd tempest-VolumesExtendTest-1701032981 None] Acquiring lock "cinder-quobyte-96e552da-2d23-47c0-a879-626f808b1b06" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:00 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5b54fec7-08ff-4406-99c6-ba89b0cb76bd tempest-VolumesExtendTest-1701032981 None] Lock "cinder-quobyte-96e552da-2d23-47c0-a879-626f808b1b06" acquired by "delete_volume" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:00 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7aeeeb2-613b-4c3b-afc5-dce05339f2b2]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5b54fec7-08ff-4406-99c6-ba89b0cb76bd tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:00 devstack sudo[93656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 Jul 07 17:24:00 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-032385fe-8ec3-47b4-a81a-6696bd11fb82 tempest-ServerActionsTestOtherA-1941139839 None] Acquiring lock "cinder-683d0b57-496d-4193-bf08-0c324ad5207a-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-032385fe-8ec3-47b4-a81a-6696bd11fb82 tempest-ServerActionsTestOtherA-1941139839 None] Lock "cinder-683d0b57-496d-4193-bf08-0c324ad5207a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-032385fe-8ec3-47b4-a81a-6696bd11fb82 tempest-ServerActionsTestOtherA-1941139839 None] Acquiring lock "cinder-quobyte-683d0b57-496d-4193-bf08-0c324ad5207a" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-032385fe-8ec3-47b4-a81a-6696bd11fb82 tempest-ServerActionsTestOtherA-1941139839 None] Lock "cinder-quobyte-683d0b57-496d-4193-bf08-0c324ad5207a" acquired by "delete_volume" :: waited 0.032s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:01 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b05f90-d3cb-4ea5-a5f3-62daf6f89645]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-032385fe-8ec3-47b4-a81a-6696bd11fb82 tempest-ServerActionsTestOtherA-1941139839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-683d0b57-496d-4193-bf08-0c324ad5207a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:01 devstack sudo[93661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-683d0b57-496d-4193-bf08-0c324ad5207a Jul 07 17:24:01 devstack sudo[93661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:01 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5b54fec7-08ff-4406-99c6-ba89b0cb76bd tempest-VolumesExtendTest-1701032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06" returned: 0 in 1.244s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5b54fec7-08ff-4406-99c6-ba89b0cb76bd tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:01 devstack sudo[93663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 Jul 07 17:24:01 devstack sudo[93663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:02 devstack sudo[93661]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-032385fe-8ec3-47b4-a81a-6696bd11fb82 tempest-ServerActionsTestOtherA-1941139839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-683d0b57-496d-4193-bf08-0c324ad5207a" returned: 0 in 1.146s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-032385fe-8ec3-47b4-a81a-6696bd11fb82 tempest-ServerActionsTestOtherA-1941139839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-683d0b57-496d-4193-bf08-0c324ad5207a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:02 devstack sudo[93672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-683d0b57-496d-4193-bf08-0c324ad5207a Jul 07 17:24:02 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:02 devstack sudo[93663]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5b54fec7-08ff-4406-99c6-ba89b0cb76bd tempest-VolumesExtendTest-1701032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06" returned: 1 in 1.004s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5b54fec7-08ff-4406-99c6-ba89b0cb76bd tempest-VolumesExtendTest-1701032981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:24:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5b54fec7-08ff-4406-99c6-ba89b0cb76bd tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:02 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06 Jul 07 17:24:02 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:03 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-032385fe-8ec3-47b4-a81a-6696bd11fb82 tempest-ServerActionsTestOtherA-1941139839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-683d0b57-496d-4193-bf08-0c324ad5207a" returned: 0 in 0.859s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:03 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5b54fec7-08ff-4406-99c6-ba89b0cb76bd tempest-VolumesExtendTest-1701032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-96e552da-2d23-47c0-a879-626f808b1b06" returned: 0 in 0.797s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-032385fe-8ec3-47b4-a81a-6696bd11fb82 tempest-ServerActionsTestOtherA-1941139839 None] Lock "cinder-quobyte-683d0b57-496d-4193-bf08-0c324ad5207a" released by "delete_volume" :: held 2.067s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5b54fec7-08ff-4406-99c6-ba89b0cb76bd tempest-VolumesExtendTest-1701032981 None] Lock "cinder-quobyte-96e552da-2d23-47c0-a879-626f808b1b06" released by "delete_volume" :: held 3.165s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:03 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-032385fe-8ec3-47b4-a81a-6696bd11fb82 tempest-ServerActionsTestOtherA-1941139839 None] Created reservations ['5749ce5c-11ae-4830-a5db-d75699ae35db', '96a277c5-502f-4365-9ed3-2c0232556798', '3293f351-6410-4a2d-a818-96a84bc877f4', '557a8d6c-a189-4b69-bb5b-5f6811f9365c'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:03 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-5b54fec7-08ff-4406-99c6-ba89b0cb76bd tempest-VolumesExtendTest-1701032981 None] Created reservations ['68c9125d-c57c-4183-bae6-c862a803a8fc', '68fea944-468a-4d51-9163-82e21fc6eb9c', 'baf33c4d-4f73-4dfd-af6a-942e166cf0a2', 'f9e35c35-e02d-48c9-961f-99d7640beacc'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-032385fe-8ec3-47b4-a81a-6696bd11fb82 tempest-ServerActionsTestOtherA-1941139839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-032385fe-8ec3-47b4-a81a-6696bd11fb82 tempest-ServerActionsTestOtherA-1941139839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:03 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-032385fe-8ec3-47b4-a81a-6696bd11fb82 tempest-ServerActionsTestOtherA-1941139839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:03 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-032385fe-8ec3-47b4-a81a-6696bd11fb82 tempest-ServerActionsTestOtherA-1941139839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-032385fe-8ec3-47b4-a81a-6696bd11fb82 tempest-ServerActionsTestOtherA-1941139839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-032385fe-8ec3-47b4-a81a-6696bd11fb82 tempest-ServerActionsTestOtherA-1941139839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5b54fec7-08ff-4406-99c6-ba89b0cb76bd tempest-VolumesExtendTest-1701032981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5b54fec7-08ff-4406-99c6-ba89b0cb76bd tempest-VolumesExtendTest-1701032981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:03 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5b54fec7-08ff-4406-99c6-ba89b0cb76bd tempest-VolumesExtendTest-1701032981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:03 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5b54fec7-08ff-4406-99c6-ba89b0cb76bd tempest-VolumesExtendTest-1701032981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5b54fec7-08ff-4406-99c6-ba89b0cb76bd tempest-VolumesExtendTest-1701032981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5b54fec7-08ff-4406-99c6-ba89b0cb76bd tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:03 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:24:03 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:03 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:24:03 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:04 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-032385fe-8ec3-47b4-a81a-6696bd11fb82 tempest-ServerActionsTestOtherA-1941139839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.801s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:04 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-032385fe-8ec3-47b4-a81a-6696bd11fb82 tempest-ServerActionsTestOtherA-1941139839 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:04 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-032385fe-8ec3-47b4-a81a-6696bd11fb82 tempest-ServerActionsTestOtherA-1941139839 None] Deleted volume successfully. Jul 07 17:24:04 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:04 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-032385fe-8ec3-47b4-a81a-6696bd11fb82 tempest-ServerActionsTestOtherA-1941139839 None] Lock "cinder-683d0b57-496d-4193-bf08-0c324ad5207a-delete_volume" released by "delete_volume" :: held 3.275s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5b54fec7-08ff-4406-99c6-ba89b0cb76bd tempest-VolumesExtendTest-1701032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.804s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:04 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-5b54fec7-08ff-4406-99c6-ba89b0cb76bd tempest-VolumesExtendTest-1701032981 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:04 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5b54fec7-08ff-4406-99c6-ba89b0cb76bd tempest-VolumesExtendTest-1701032981 None] Deleted volume successfully. Jul 07 17:24:04 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5b54fec7-08ff-4406-99c6-ba89b0cb76bd tempest-VolumesExtendTest-1701032981 None] Lock "cinder-96e552da-2d23-47c0-a879-626f808b1b06-delete_volume" released by "delete_volume" :: held 4.356s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:05 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:UPDATE=120,cinder:SELECT=91,cinder:DELETE=8,cinder:INSERT=29 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:24:05 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:24:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Flow 'volume_create_manager' (a8cc3d53-7418-4a8c-855e-b201757dffc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649ebfa9-610a-4f8f-a17d-5b7ed5d13fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649ebfa9-610a-4f8f-a17d-5b7ed5d13fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1058359870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45883e01-ba51-48df-beee-bc1c63f58676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f20af55aff7241b794c30a3d6e91cc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:06Z,use_quota=True,user_id='0aa8817bab6a463a9acdc88a25956444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9421ffb0-8aa2-403b-9533-a3c195c4ad02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9421ffb0-8aa2-403b-9533-a3c195c4ad02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d367305e-b8c1-400f-9dd4-df65e3c62abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d367305e-b8c1-400f-9dd4-df65e3c62abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45883e01-ba51-48df-beee-bc1c63f58676', 'volume_name': 'volume-45883e01-ba51-48df-beee-bc1c63f58676', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc6f1bd-8b11-4dc5-be56-078042325183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc6f1bd-8b11-4dc5-be56-078042325183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37309733-d0ec-4cf0-926e-389e5de772cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:05 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Volume 45883e01-ba51-48df-beee-bc1c63f58676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45883e01-ba51-48df-beee-bc1c63f58676', 'volume_size': 1} Jul 07 17:24:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1058359870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45883e01-ba51-48df-beee-bc1c63f58676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f20af55aff7241b794c30a3d6e91cc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:06Z,use_quota=True,user_id='0aa8817bab6a463a9acdc88a25956444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:24:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Creating volume 45883e01-ba51-48df-beee-bc1c63f58676 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:24:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:24:05 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:24:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:05 devstack sudo[93696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676 1073741824 Jul 07 17:24:05 devstack sudo[93696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:06 devstack sudo[93696]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676 1073741824" returned: 0 in 1.068s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:06 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=86,cinder:INSERT=36,cinder:UPDATE=98,cinder:DELETE=6 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:24:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:06 devstack sudo[93720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676 Jul 07 17:24:06 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:07 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676" returned: 0 in 0.910s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:24:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37309733-d0ec-4cf0-926e-389e5de772cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45883e01-ba51-48df-beee-bc1c63f58676', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e03d822-8483-4c76-a7aa-a2e22df9f319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:07 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Volume volume-45883e01-ba51-48df-beee-bc1c63f58676 (45883e01-ba51-48df-beee-bc1c63f58676): created successfully Jul 07 17:24:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e03d822-8483-4c76-a7aa-a2e22df9f319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Flow 'volume_create_manager' (a8cc3d53-7418-4a8c-855e-b201757dffc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:07 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-404e45fd-21b0-45f0-b978-3640dd875595 tempest-VolumesExtendTest-1701032981 None] Created volume successfully. Jul 07 17:24:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b69cd238-c942-48d2-b91b-e9fb3ad7a8d3 tempest-VolumesExtendTest-1701032981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b69cd238-c942-48d2-b91b-e9fb3ad7a8d3 tempest-VolumesExtendTest-1701032981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-b69cd238-c942-48d2-b91b-e9fb3ad7a8d3 tempest-VolumesExtendTest-1701032981 None] Creating offline snapshot da73d460-266f-40a0-bc91-e9e8e7fa698f of volume 45883e01-ba51-48df-beee-bc1c63f58676 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:24:08 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1b9a00-9f90-4ec1-8094-80776689a1ff]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b69cd238-c942-48d2-b91b-e9fb3ad7a8d3 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:09 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676 Jul 07 17:24:09 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:09 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b69cd238-c942-48d2-b91b-e9fb3ad7a8d3 tempest-VolumesExtendTest-1701032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676" returned: 0 in 0.870s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b69cd238-c942-48d2-b91b-e9fb3ad7a8d3 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.da73d460-266f-40a0-bc91-e9e8e7fa698f 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:09 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.da73d460-266f-40a0-bc91-e9e8e7fa698f 1G Jul 07 17:24:09 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:10 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b69cd238-c942-48d2-b91b-e9fb3ad7a8d3 tempest-VolumesExtendTest-1701032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.da73d460-266f-40a0-bc91-e9e8e7fa698f 1G" returned: 0 in 0.860s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b69cd238-c942-48d2-b91b-e9fb3ad7a8d3 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45883e01-ba51-48df-beee-bc1c63f58676 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.da73d460-266f-40a0-bc91-e9e8e7fa698f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:10 devstack sudo[93742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45883e01-ba51-48df-beee-bc1c63f58676 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.da73d460-266f-40a0-bc91-e9e8e7fa698f Jul 07 17:24:10 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:11 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b69cd238-c942-48d2-b91b-e9fb3ad7a8d3 tempest-VolumesExtendTest-1701032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45883e01-ba51-48df-beee-bc1c63f58676 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.da73d460-266f-40a0-bc91-e9e8e7fa698f" returned: 0 in 0.928s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:11 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-b69cd238-c942-48d2-b91b-e9fb3ad7a8d3 tempest-VolumesExtendTest-1701032981 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.da73d460-266f-40a0-bc91-e9e8e7fa698f is being set with open permissions: ugo+rw Jul 07 17:24:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b69cd238-c942-48d2-b91b-e9fb3ad7a8d3 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.da73d460-266f-40a0-bc91-e9e8e7fa698f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:11 devstack sudo[93748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.da73d460-266f-40a0-bc91-e9e8e7fa698f Jul 07 17:24:11 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:12 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b69cd238-c942-48d2-b91b-e9fb3ad7a8d3 tempest-VolumesExtendTest-1701032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.da73d460-266f-40a0-bc91-e9e8e7fa698f" returned: 0 in 0.951s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b69cd238-c942-48d2-b91b-e9fb3ad7a8d3 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:12 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.info Jul 07 17:24:12 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:13 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b69cd238-c942-48d2-b91b-e9fb3ad7a8d3 tempest-VolumesExtendTest-1701032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.info" returned: 0 in 0.889s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:13 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-b69cd238-c942-48d2-b91b-e9fb3ad7a8d3 tempest-VolumesExtendTest-1701032981 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.info is being set with open permissions: ugo+rw Jul 07 17:24:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b69cd238-c942-48d2-b91b-e9fb3ad7a8d3 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:13 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.info Jul 07 17:24:13 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:14 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b69cd238-c942-48d2-b91b-e9fb3ad7a8d3 tempest-VolumesExtendTest-1701032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.info" returned: 0 in 1.145s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b69cd238-c942-48d2-b91b-e9fb3ad7a8d3 tempest-VolumesExtendTest-1701032981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.803s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:14 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b69cd238-c942-48d2-b91b-e9fb3ad7a8d3 tempest-VolumesExtendTest-1701032981 None] Create snapshot completed successfully Jul 07 17:24:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-28527640-50c1-4b00-a911-9be392c26a56 tempest-VolumesExtendTest-1701032981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-28527640-50c1-4b00-a911-9be392c26a56 tempest-VolumesExtendTest-1701032981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:15 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8229fbe-af69-4f28-a0dd-1cf8803fa4be]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-28527640-50c1-4b00-a911-9be392c26a56 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:15 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676 Jul 07 17:24:15 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:16 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-28527640-50c1-4b00-a911-9be392c26a56 tempest-VolumesExtendTest-1701032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676" returned: 0 in 1.052s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-28527640-50c1-4b00-a911-9be392c26a56 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.da73d460-266f-40a0-bc91-e9e8e7fa698f 2G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-28527640-50c1-4b00-a911-9be392c26a56 tempest-VolumesExtendTest-1701032981 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.da73d460-266f-40a0-bc91-e9e8e7fa698f 2G" returned: 0 in 0.198s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-28527640-50c1-4b00-a911-9be392c26a56 tempest-VolumesExtendTest-1701032981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.315s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:16 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-28527640-50c1-4b00-a911-9be392c26a56 tempest-VolumesExtendTest-1701032981 None] Extend volume completed successfully. Jul 07 17:24:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9cc379a8-435c-40c1-ba11-2ed77fb8b2f3 tempest-VolumesExtendTest-1701032981 None] Acquiring lock "cinder-da73d460-266f-40a0-bc91-e9e8e7fa698f-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9cc379a8-435c-40c1-ba11-2ed77fb8b2f3 tempest-VolumesExtendTest-1701032981 None] Lock "cinder-da73d460-266f-40a0-bc91-e9e8e7fa698f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9cc379a8-435c-40c1-ba11-2ed77fb8b2f3 tempest-VolumesExtendTest-1701032981 None] Acquiring lock "cinder-quobyte-45883e01-ba51-48df-beee-bc1c63f58676" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9cc379a8-435c-40c1-ba11-2ed77fb8b2f3 tempest-VolumesExtendTest-1701032981 None] Lock "cinder-quobyte-45883e01-ba51-48df-beee-bc1c63f58676" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9cc379a8-435c-40c1-ba11-2ed77fb8b2f3 tempest-VolumesExtendTest-1701032981 None] Acquiring lock "cinder-quobyte-da73d460-266f-40a0-bc91-e9e8e7fa698f" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9cc379a8-435c-40c1-ba11-2ed77fb8b2f3 tempest-VolumesExtendTest-1701032981 None] Lock "cinder-quobyte-da73d460-266f-40a0-bc91-e9e8e7fa698f" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-9cc379a8-435c-40c1-ba11-2ed77fb8b2f3 tempest-VolumesExtendTest-1701032981 None] Deleting offline snapshot da73d460-266f-40a0-bc91-e9e8e7fa698f of volume 45883e01-ba51-48df-beee-bc1c63f58676 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:24:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-9cc379a8-435c-40c1-ba11-2ed77fb8b2f3 tempest-VolumesExtendTest-1701032981 None] snapshot_file for this snap is: volume-45883e01-ba51-48df-beee-bc1c63f58676.da73d460-266f-40a0-bc91-e9e8e7fa698f {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:24:17 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc2c470-d1d5-4462-8789-8e1c14d94f91]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9cc379a8-435c-40c1-ba11-2ed77fb8b2f3 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.da73d460-266f-40a0-bc91-e9e8e7fa698f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:18 devstack sudo[93789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.da73d460-266f-40a0-bc91-e9e8e7fa698f Jul 07 17:24:18 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:19 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9cc379a8-435c-40c1-ba11-2ed77fb8b2f3 tempest-VolumesExtendTest-1701032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.da73d460-266f-40a0-bc91-e9e8e7fa698f" returned: 0 in 1.180s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-9cc379a8-435c-40c1-ba11-2ed77fb8b2f3 tempest-VolumesExtendTest-1701032981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45883e01-ba51-48df-beee-bc1c63f58676(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9b1c2b-6ae9-49dc-9844-121766c91a79]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9cc379a8-435c-40c1-ba11-2ed77fb8b2f3 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Flow 'volume_create_manager' (9c71839a-e6b5-44a8-9aad-98e4a12c8f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (936ef89f-dc98-4faf-a266-16b03277a026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (936ef89f-dc98-4faf-a266-16b03277a026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-104105329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e0b7e85-88cd-4828-9cb7-25166eafc3b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ea1fd4c9cd4c3ebe0b65c3d473b5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:19Z,use_quota=True,user_id='0f21c08ade26414781d2763380855d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee471b3-1641-45d9-815c-18808f15b538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee471b3-1641-45d9-815c-18808f15b538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e1c541-7fb8-4626-acff-759b177927a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e1c541-7fb8-4626-acff-759b177927a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e0b7e85-88cd-4828-9cb7-25166eafc3b0', 'volume_name': 'volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:19 devstack sudo[93794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676 Jul 07 17:24:19 devstack sudo[93794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df063e3-1975-4110-a7fd-3d286858fb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df063e3-1975-4110-a7fd-3d286858fb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e122494-6054-48a3-9572-eb814545469a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:19 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Volume 6e0b7e85-88cd-4828-9cb7-25166eafc3b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0', 'volume_size': 1} Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-104105329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e0b7e85-88cd-4828-9cb7-25166eafc3b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ea1fd4c9cd4c3ebe0b65c3d473b5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:19Z,use_quota=True,user_id='0f21c08ade26414781d2763380855d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Creating volume 6e0b7e85-88cd-4828-9cb7-25166eafc3b0 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:24:19 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:24:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:19 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 1073741824 Jul 07 17:24:19 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:20 devstack sudo[93794]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9cc379a8-435c-40c1-ba11-2ed77fb8b2f3 tempest-VolumesExtendTest-1701032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676" returned: 0 in 1.218s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9cc379a8-435c-40c1-ba11-2ed77fb8b2f3 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.da73d460-266f-40a0-bc91-e9e8e7fa698f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:20 devstack sudo[93806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.da73d460-266f-40a0-bc91-e9e8e7fa698f Jul 07 17:24:20 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:20 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 1073741824" returned: 0 in 1.249s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:20 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 Jul 07 17:24:20 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:21 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9cc379a8-435c-40c1-ba11-2ed77fb8b2f3 tempest-VolumesExtendTest-1701032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.da73d460-266f-40a0-bc91-e9e8e7fa698f" returned: 0 in 1.118s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9cc379a8-435c-40c1-ba11-2ed77fb8b2f3 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.da73d460-266f-40a0-bc91-e9e8e7fa698f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:21 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.da73d460-266f-40a0-bc91-e9e8e7fa698f Jul 07 17:24:21 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:21 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0" returned: 0 in 0.885s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] <== create_volume: return (2214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:24:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.217s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e122494-6054-48a3-9572-eb814545469a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9652907e-ad78-4479-846c-6b176ea677dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:21 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Volume volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 (6e0b7e85-88cd-4828-9cb7-25166eafc3b0): created successfully Jul 07 17:24:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9652907e-ad78-4479-846c-6b176ea677dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Flow 'volume_create_manager' (9c71839a-e6b5-44a8-9aad-98e4a12c8f08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:21 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-73081986-d3bf-4b0e-ba3d-86e636183fd4 tempest-VolumesActionsTest-1833333682 None] Created volume successfully. Jul 07 17:24:22 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9cc379a8-435c-40c1-ba11-2ed77fb8b2f3 tempest-VolumesExtendTest-1701032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676.da73d460-266f-40a0-bc91-e9e8e7fa698f" returned: 0 in 0.858s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:22 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9cc379a8-435c-40c1-ba11-2ed77fb8b2f3 tempest-VolumesExtendTest-1701032981 None] Lock "cinder-quobyte-da73d460-266f-40a0-bc91-e9e8e7fa698f" released by "_delete_snapshot" :: held 4.537s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:22 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9cc379a8-435c-40c1-ba11-2ed77fb8b2f3 tempest-VolumesExtendTest-1701032981 None] Lock "cinder-quobyte-45883e01-ba51-48df-beee-bc1c63f58676" released by "delete_snapshot" :: held 4.591s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:22 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-9cc379a8-435c-40c1-ba11-2ed77fb8b2f3 tempest-VolumesExtendTest-1701032981 None] Created reservations ['3b2080c5-fc0c-46b0-8606-f5d89c37185a', '6697d97e-1713-443c-9916-b14d68f2e4e0', '474bda2b-1266-428b-ac6f-08606b95c624', '9864a351-20d6-469b-8141-f759303e008d'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:22 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-9cc379a8-435c-40c1-ba11-2ed77fb8b2f3 tempest-VolumesExtendTest-1701032981 None] Delete snapshot completed successfully. Jul 07 17:24:22 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9cc379a8-435c-40c1-ba11-2ed77fb8b2f3 tempest-VolumesExtendTest-1701032981 None] Lock "cinder-da73d460-266f-40a0-bc91-e9e8e7fa698f-delete_snapshot" released by "delete_snapshot" :: held 4.884s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:23 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dc2fd14c-bea8-4e0e-a59f-863268779d23 tempest-VolumesExtendTest-1701032981 None] Acquiring lock "cinder-45883e01-ba51-48df-beee-bc1c63f58676-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:23 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dc2fd14c-bea8-4e0e-a59f-863268779d23 tempest-VolumesExtendTest-1701032981 None] Lock "cinder-45883e01-ba51-48df-beee-bc1c63f58676-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:23 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dc2fd14c-bea8-4e0e-a59f-863268779d23 tempest-VolumesExtendTest-1701032981 None] Acquiring lock "cinder-quobyte-45883e01-ba51-48df-beee-bc1c63f58676" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:23 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dc2fd14c-bea8-4e0e-a59f-863268779d23 tempest-VolumesExtendTest-1701032981 None] Lock "cinder-quobyte-45883e01-ba51-48df-beee-bc1c63f58676" acquired by "delete_volume" :: waited 0.040s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:23 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[755733cb-b1d8-46dc-9ef1-466686cc81d0]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dc2fd14c-bea8-4e0e-a59f-863268779d23 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:23 devstack sudo[93864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676 Jul 07 17:24:23 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:24 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dc2fd14c-bea8-4e0e-a59f-863268779d23 tempest-VolumesExtendTest-1701032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676" returned: 0 in 1.211s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dc2fd14c-bea8-4e0e-a59f-863268779d23 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:24 devstack sudo[93895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676 Jul 07 17:24:24 devstack sudo[93895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:25 devstack sudo[93895]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dc2fd14c-bea8-4e0e-a59f-863268779d23 tempest-VolumesExtendTest-1701032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45883e01-ba51-48df-beee-bc1c63f58676" returned: 0 in 0.737s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dc2fd14c-bea8-4e0e-a59f-863268779d23 tempest-VolumesExtendTest-1701032981 None] Lock "cinder-quobyte-45883e01-ba51-48df-beee-bc1c63f58676" released by "delete_volume" :: held 2.020s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:25 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-dc2fd14c-bea8-4e0e-a59f-863268779d23 tempest-VolumesExtendTest-1701032981 None] Created reservations ['ed5e9b07-a645-4dae-9972-dbaaa29f8349', '4ec284f4-ae46-488e-bcd9-3e6164a09030', 'fbb29f67-0a5a-46f1-b969-5dca8fa160e3', 'a003c57c-c44e-4a5d-94d8-db6d887a0b7b'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dc2fd14c-bea8-4e0e-a59f-863268779d23 tempest-VolumesExtendTest-1701032981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dc2fd14c-bea8-4e0e-a59f-863268779d23 tempest-VolumesExtendTest-1701032981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dc2fd14c-bea8-4e0e-a59f-863268779d23 tempest-VolumesExtendTest-1701032981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dc2fd14c-bea8-4e0e-a59f-863268779d23 tempest-VolumesExtendTest-1701032981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dc2fd14c-bea8-4e0e-a59f-863268779d23 tempest-VolumesExtendTest-1701032981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dc2fd14c-bea8-4e0e-a59f-863268779d23 tempest-VolumesExtendTest-1701032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:25 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:24:25 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:26 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dc2fd14c-bea8-4e0e-a59f-863268779d23 tempest-VolumesExtendTest-1701032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.899s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:26 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-dc2fd14c-bea8-4e0e-a59f-863268779d23 tempest-VolumesExtendTest-1701032981 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:26 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-dc2fd14c-bea8-4e0e-a59f-863268779d23 tempest-VolumesExtendTest-1701032981 None] Deleted volume successfully. Jul 07 17:24:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dc2fd14c-bea8-4e0e-a59f-863268779d23 tempest-VolumesExtendTest-1701032981 None] Lock "cinder-45883e01-ba51-48df-beee-bc1c63f58676-delete_volume" released by "delete_volume" :: held 3.205s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:28 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:24:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Flow 'volume_create_manager' (8e1e2ed9-a93a-4316-ac6d-995d3f03bbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be45d9a-aca0-4784-bdf6-edba2855a433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be45d9a-aca0-4784-bdf6-edba2855a433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1436615558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9daea2-fe2b-4e15-a4ec-22b04ac64fd8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d464af4b30f4de2998df426fe145224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:28Z,use_quota=True,user_id='07262bb2071e47bc8fb5d4d6827edb08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd8e4cb-e88a-43f0-af99-3db38e086426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd8e4cb-e88a-43f0-af99-3db38e086426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d5d3d3-8841-4a44-b42d-b9b5c86e476d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d5d3d3-8841-4a44-b42d-b9b5c86e476d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da9daea2-fe2b-4e15-a4ec-22b04ac64fd8', 'volume_name': 'volume-da9daea2-fe2b-4e15-a4ec-22b04ac64fd8', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1d08b35-cad5-4a73-8020-a20ce5641043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1d08b35-cad5-4a73-8020-a20ce5641043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0bbe64f-f897-4efe-b74a-c44e16796180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:28 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Volume da9daea2-fe2b-4e15-a4ec-22b04ac64fd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da9daea2-fe2b-4e15-a4ec-22b04ac64fd8', 'volume_size': 1} Jul 07 17:24:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1436615558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9daea2-fe2b-4e15-a4ec-22b04ac64fd8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d464af4b30f4de2998df426fe145224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:28Z,use_quota=True,user_id='07262bb2071e47bc8fb5d4d6827edb08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:24:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Creating volume da9daea2-fe2b-4e15-a4ec-22b04ac64fd8 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:24:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:24:28 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:24:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da9daea2-fe2b-4e15-a4ec-22b04ac64fd8 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:28 devstack sudo[93905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da9daea2-fe2b-4e15-a4ec-22b04ac64fd8 1073741824 Jul 07 17:24:28 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:30 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da9daea2-fe2b-4e15-a4ec-22b04ac64fd8 1073741824" returned: 0 in 2.085s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da9daea2-fe2b-4e15-a4ec-22b04ac64fd8 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:30 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da9daea2-fe2b-4e15-a4ec-22b04ac64fd8 Jul 07 17:24:30 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Flow 'volume_create_manager' (f52ae217-aec0-4ef8-8762-3f26cac81602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11471c68-c1bd-4c9e-880a-a0e12e14ef39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11471c68-c1bd-4c9e-880a-a0e12e14ef39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1905741034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3651dda8-f703-402d-94c4-9e08febb438a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbf57a5f26242f880c7653a97727fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:32Z,use_quota=True,user_id='ecba7774b2b74b8f843e3eb49abfceb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b645cd-ad32-4a1a-ba8f-1a6dff9ceafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b645cd-ad32-4a1a-ba8f-1a6dff9ceafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08c549e-b63e-4f42-8b85-6102b5fe6a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08c549e-b63e-4f42-8b85-6102b5fe6a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3651dda8-f703-402d-94c4-9e08febb438a', 'volume_name': 'volume-3651dda8-f703-402d-94c4-9e08febb438a', 'volume_size': 2}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4828212-ecc9-47d4-96da-8db7c6887962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4828212-ecc9-47d4-96da-8db7c6887962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:32 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36708ca2-7330-4559-bcd9-a58a331d96b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:32 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Volume 3651dda8-f703-402d-94c4-9e08febb438a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3651dda8-f703-402d-94c4-9e08febb438a', 'volume_size': 2} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da9daea2-fe2b-4e15-a4ec-22b04ac64fd8" returned: 0 in 1.767s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] <== create_volume: return (3946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.948s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1905741034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3651dda8-f703-402d-94c4-9e08febb438a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbf57a5f26242f880c7653a97727fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:32Z,use_quota=True,user_id='ecba7774b2b74b8f843e3eb49abfceb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Creating volume 3651dda8-f703-402d-94c4-9e08febb438a {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:24:32 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a 2147483648 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:32 devstack sudo[93934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a 2147483648 Jul 07 17:24:32 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0bbe64f-f897-4efe-b74a-c44e16796180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da9daea2-fe2b-4e15-a4ec-22b04ac64fd8', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4a19ea-dbcf-4a18-89a1-777cf43c0145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:32 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Volume volume-da9daea2-fe2b-4e15-a4ec-22b04ac64fd8 (da9daea2-fe2b-4e15-a4ec-22b04ac64fd8): created successfully Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4a19ea-dbcf-4a18-89a1-777cf43c0145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Flow 'volume_create_manager' (8e1e2ed9-a93a-4316-ac6d-995d3f03bbad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:32 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-59c07054-0929-4987-9aee-d6771092099c tempest-VolumesTestJSON-1638446596 None] Created volume successfully. Jul 07 17:24:33 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:24:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Flow 'volume_create_manager' (e04d6e19-ac49-4ae8-a281-d198db815848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c91a59-d6b5-4efd-9c9f-f2aa7c8e87b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c91a59-d6b5-4efd-9c9f-f2aa7c8e87b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1507307485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f7c836-99cc-48e1-9104-1d0ee04b7e86,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d464af4b30f4de2998df426fe145224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:34Z,use_quota=True,user_id='07262bb2071e47bc8fb5d4d6827edb08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2fcdff-ae29-4619-9e78-f0fce1724abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2fcdff-ae29-4619-9e78-f0fce1724abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd89f26e-3e36-4ea2-997b-880f28e2eced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd89f26e-3e36-4ea2-997b-880f28e2eced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45f7c836-99cc-48e1-9104-1d0ee04b7e86', 'volume_name': 'volume-45f7c836-99cc-48e1-9104-1d0ee04b7e86', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b583b842-fc69-420f-a2aa-f858a29b7ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b583b842-fc69-420f-a2aa-f858a29b7ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d01f0f0-04a1-4f8f-837f-5d1d410b9923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:33 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Volume 45f7c836-99cc-48e1-9104-1d0ee04b7e86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45f7c836-99cc-48e1-9104-1d0ee04b7e86', 'volume_size': 1} Jul 07 17:24:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:34 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a 2147483648" returned: 0 in 1.677s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:34 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a Jul 07 17:24:34 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:34 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a" returned: 0 in 0.715s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] <== create_volume: return (2456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:24:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.460s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.039s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1507307485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f7c836-99cc-48e1-9104-1d0ee04b7e86,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d464af4b30f4de2998df426fe145224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:34Z,use_quota=True,user_id='07262bb2071e47bc8fb5d4d6827edb08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:24:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Creating volume 45f7c836-99cc-48e1-9104-1d0ee04b7e86 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:24:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:24:34 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:24:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45f7c836-99cc-48e1-9104-1d0ee04b7e86 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36708ca2-7330-4559-bcd9-a58a331d96b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3651dda8-f703-402d-94c4-9e08febb438a', 'volume_size': 2}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:34 devstack sudo[93944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45f7c836-99cc-48e1-9104-1d0ee04b7e86 1073741824 Jul 07 17:24:34 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec48a458-176d-4682-b589-c7bb940ffc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:35 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Volume volume-3651dda8-f703-402d-94c4-9e08febb438a (3651dda8-f703-402d-94c4-9e08febb438a): created successfully Jul 07 17:24:35 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec48a458-176d-4682-b589-c7bb940ffc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:35 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Flow 'volume_create_manager' (f52ae217-aec0-4ef8-8762-3f26cac81602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:35 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b2bd9371-1743-4466-a93c-e7e29d2455af tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Created volume successfully. Jul 07 17:24:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-175e20be-e5ad-4072-9a8e-081e9889a300 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:36 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45f7c836-99cc-48e1-9104-1d0ee04b7e86 1073741824" returned: 0 in 1.104s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45f7c836-99cc-48e1-9104-1d0ee04b7e86 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:36 devstack sudo[93949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45f7c836-99cc-48e1-9104-1d0ee04b7e86 Jul 07 17:24:36 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:37 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45f7c836-99cc-48e1-9104-1d0ee04b7e86" returned: 0 in 1.024s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] <== create_volume: return (2174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:24:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.177s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-175e20be-e5ad-4072-9a8e-081e9889a300 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.334s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d01f0f0-04a1-4f8f-837f-5d1d410b9923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45f7c836-99cc-48e1-9104-1d0ee04b7e86', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02b4b135-5b99-4c72-9339-d4388365d98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-175e20be-e5ad-4072-9a8e-081e9889a300 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Creating offline snapshot a078a7a1-b3be-4e5d-a3cc-9bb013536e8c of volume 3651dda8-f703-402d-94c4-9e08febb438a {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:24:37 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Volume volume-45f7c836-99cc-48e1-9104-1d0ee04b7e86 (45f7c836-99cc-48e1-9104-1d0ee04b7e86): created successfully Jul 07 17:24:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02b4b135-5b99-4c72-9339-d4388365d98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Flow 'volume_create_manager' (e04d6e19-ac49-4ae8-a281-d198db815848) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:37 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fe45fb-d5dc-41a8-a286-c241d1e140b2]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-175e20be-e5ad-4072-9a8e-081e9889a300 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:37 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-33e7e53b-8496-4156-98b1-4892718ca2ab tempest-VolumesTestJSON-1638446596 None] Created volume successfully. Jul 07 17:24:37 devstack sudo[93983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a Jul 07 17:24:37 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:38 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-175e20be-e5ad-4072-9a8e-081e9889a300 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a" returned: 0 in 1.324s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-175e20be-e5ad-4072-9a8e-081e9889a300 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.a078a7a1-b3be-4e5d-a3cc-9bb013536e8c 2G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:38 devstack sudo[94047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.a078a7a1-b3be-4e5d-a3cc-9bb013536e8c 2G Jul 07 17:24:38 devstack sudo[94047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:39 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:24:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Flow 'volume_create_manager' (fb00c5f1-121e-4b59-8f4b-283e5d4f5b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ccf56e-d2f6-4ae3-8e7b-e77d0af4f234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ccf56e-d2f6-4ae3-8e7b-e77d0af4f234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1423891055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7118a916-f33a-4df3-99d6-fbc02f35ad65,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d464af4b30f4de2998df426fe145224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:39Z,use_quota=True,user_id='07262bb2071e47bc8fb5d4d6827edb08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd53a21-a55d-4825-952a-1480180ccd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd53a21-a55d-4825-952a-1480180ccd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14ed12e-1258-4148-8018-e24b4b9f60d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14ed12e-1258-4148-8018-e24b4b9f60d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7118a916-f33a-4df3-99d6-fbc02f35ad65', 'volume_name': 'volume-7118a916-f33a-4df3-99d6-fbc02f35ad65', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7251a7a0-f179-4788-8449-de58a26fdbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7251a7a0-f179-4788-8449-de58a26fdbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (884a146c-b85f-4e7f-ba2b-c96604de7f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:39 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Volume 7118a916-f33a-4df3-99d6-fbc02f35ad65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7118a916-f33a-4df3-99d6-fbc02f35ad65', 'volume_size': 1} Jul 07 17:24:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:39 devstack sudo[94047]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-175e20be-e5ad-4072-9a8e-081e9889a300 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.a078a7a1-b3be-4e5d-a3cc-9bb013536e8c 2G" returned: 0 in 1.172s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-175e20be-e5ad-4072-9a8e-081e9889a300 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3651dda8-f703-402d-94c4-9e08febb438a -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.a078a7a1-b3be-4e5d-a3cc-9bb013536e8c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:39 devstack sudo[94069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3651dda8-f703-402d-94c4-9e08febb438a -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.a078a7a1-b3be-4e5d-a3cc-9bb013536e8c Jul 07 17:24:39 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:40 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-175e20be-e5ad-4072-9a8e-081e9889a300 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3651dda8-f703-402d-94c4-9e08febb438a -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.a078a7a1-b3be-4e5d-a3cc-9bb013536e8c" returned: 0 in 0.835s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:40 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-175e20be-e5ad-4072-9a8e-081e9889a300 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.a078a7a1-b3be-4e5d-a3cc-9bb013536e8c is being set with open permissions: ugo+rw Jul 07 17:24:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-175e20be-e5ad-4072-9a8e-081e9889a300 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.a078a7a1-b3be-4e5d-a3cc-9bb013536e8c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:40 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.a078a7a1-b3be-4e5d-a3cc-9bb013536e8c Jul 07 17:24:40 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:41 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-175e20be-e5ad-4072-9a8e-081e9889a300 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.a078a7a1-b3be-4e5d-a3cc-9bb013536e8c" returned: 0 in 0.771s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-175e20be-e5ad-4072-9a8e-081e9889a300 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:41 devstack sudo[94108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.info Jul 07 17:24:41 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:42 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-175e20be-e5ad-4072-9a8e-081e9889a300 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.info" returned: 0 in 0.711s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:42 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-175e20be-e5ad-4072-9a8e-081e9889a300 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.info is being set with open permissions: ugo+rw Jul 07 17:24:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-175e20be-e5ad-4072-9a8e-081e9889a300 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:42 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.info Jul 07 17:24:42 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:42 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-61da6f2c-aed4-4b81-8c62-0dfd7ee8624d tempest-VolumesActionsTest-1833333682 None] Acquiring lock "cinder-6e0b7e85-88cd-4828-9cb7-25166eafc3b0" by "attach_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:42 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-61da6f2c-aed4-4b81-8c62-0dfd7ee8624d tempest-VolumesActionsTest-1833333682 None] Lock "cinder-6e0b7e85-88cd-4828-9cb7-25166eafc3b0" acquired by "attach_volume" :: waited 0.026s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:42 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-61da6f2c-aed4-4b81-8c62-0dfd7ee8624d tempest-VolumesActionsTest-1833333682 None] Attaching volume 6e0b7e85-88cd-4828-9cb7-25166eafc3b0 to instance f289f6d6-8b7f-4d38-9096-62eb7ef58d7c at mountpoint /dev/vdb on host None. Jul 07 17:24:42 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-61da6f2c-aed4-4b81-8c62-0dfd7ee8624d tempest-VolumesActionsTest-1833333682 None] Attach volume completed successfully. Jul 07 17:24:42 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-61da6f2c-aed4-4b81-8c62-0dfd7ee8624d tempest-VolumesActionsTest-1833333682 None] Lock "cinder-6e0b7e85-88cd-4828-9cb7-25166eafc3b0" released by "attach_volume" :: held 0.151s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:42 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-175e20be-e5ad-4072-9a8e-081e9889a300 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.info" returned: 0 in 0.866s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-175e20be-e5ad-4072-9a8e-081e9889a300 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.880s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.709s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1423891055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7118a916-f33a-4df3-99d6-fbc02f35ad65,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d464af4b30f4de2998df426fe145224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:39Z,use_quota=True,user_id='07262bb2071e47bc8fb5d4d6827edb08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:24:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Creating volume 7118a916-f33a-4df3-99d6-fbc02f35ad65 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:24:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:24:43 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:24:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7118a916-f33a-4df3-99d6-fbc02f35ad65 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:43 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7118a916-f33a-4df3-99d6-fbc02f35ad65 1073741824 Jul 07 17:24:43 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-51f1f320-e5f8-467b-a597-249581b44e98 tempest-VolumesActionsTest-1833333682 None] Acquiring lock "cinder-6e0b7e85-88cd-4828-9cb7-25166eafc3b0-detach_volume" by "detach_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:43 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:43 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-175e20be-e5ad-4072-9a8e-081e9889a300 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Create snapshot completed successfully Jul 07 17:24:43 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-51f1f320-e5f8-467b-a597-249581b44e98 tempest-VolumesActionsTest-1833333682 None] Lock "cinder-6e0b7e85-88cd-4828-9cb7-25166eafc3b0-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:43 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-51f1f320-e5f8-467b-a597-249581b44e98 tempest-VolumesActionsTest-1833333682 None] Detaching volume 6e0b7e85-88cd-4828-9cb7-25166eafc3b0 from instance f289f6d6-8b7f-4d38-9096-62eb7ef58d7c. Jul 07 17:24:43 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-51f1f320-e5f8-467b-a597-249581b44e98 tempest-VolumesActionsTest-1833333682 None] Detach volume completed successfully. Jul 07 17:24:43 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-51f1f320-e5f8-467b-a597-249581b44e98 tempest-VolumesActionsTest-1833333682 None] Lock "cinder-6e0b7e85-88cd-4828-9cb7-25166eafc3b0-detach_volume" released by "detach_volume" :: held 0.097s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:43 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dddceb0a-3ff2-4451-8743-3b8ac68b4cc6 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Acquiring lock "cinder-a078a7a1-b3be-4e5d-a3cc-9bb013536e8c-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:43 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dddceb0a-3ff2-4451-8743-3b8ac68b4cc6 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Lock "cinder-a078a7a1-b3be-4e5d-a3cc-9bb013536e8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:43 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dddceb0a-3ff2-4451-8743-3b8ac68b4cc6 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Acquiring lock "cinder-quobyte-3651dda8-f703-402d-94c4-9e08febb438a" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:43 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dddceb0a-3ff2-4451-8743-3b8ac68b4cc6 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Lock "cinder-quobyte-3651dda8-f703-402d-94c4-9e08febb438a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:43 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dddceb0a-3ff2-4451-8743-3b8ac68b4cc6 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Acquiring lock "cinder-quobyte-a078a7a1-b3be-4e5d-a3cc-9bb013536e8c" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:43 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dddceb0a-3ff2-4451-8743-3b8ac68b4cc6 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Lock "cinder-quobyte-a078a7a1-b3be-4e5d-a3cc-9bb013536e8c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:43 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-dddceb0a-3ff2-4451-8743-3b8ac68b4cc6 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Deleting offline snapshot a078a7a1-b3be-4e5d-a3cc-9bb013536e8c of volume 3651dda8-f703-402d-94c4-9e08febb438a {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:24:43 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-dddceb0a-3ff2-4451-8743-3b8ac68b4cc6 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] snapshot_file for this snap is: volume-3651dda8-f703-402d-94c4-9e08febb438a.a078a7a1-b3be-4e5d-a3cc-9bb013536e8c {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:24:43 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e7c304-6cba-44bf-bbdb-0a64e5fc4bd4]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dddceb0a-3ff2-4451-8743-3b8ac68b4cc6 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.a078a7a1-b3be-4e5d-a3cc-9bb013536e8c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:43 devstack sudo[94116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.a078a7a1-b3be-4e5d-a3cc-9bb013536e8c Jul 07 17:24:43 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:44 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7118a916-f33a-4df3-99d6-fbc02f35ad65 1073741824" returned: 0 in 1.150s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7118a916-f33a-4df3-99d6-fbc02f35ad65 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:44 devstack sudo[94123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7118a916-f33a-4df3-99d6-fbc02f35ad65 Jul 07 17:24:44 devstack sudo[94123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:44 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dddceb0a-3ff2-4451-8743-3b8ac68b4cc6 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.a078a7a1-b3be-4e5d-a3cc-9bb013536e8c" returned: 0 in 1.003s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-dddceb0a-3ff2-4451-8743-3b8ac68b4cc6 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3651dda8-f703-402d-94c4-9e08febb438a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:24:44 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0a2296-cd92-4ab8-99f2-fd4ce6c797a9]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dddceb0a-3ff2-4451-8743-3b8ac68b4cc6 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:44 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a Jul 07 17:24:44 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:44 devstack sudo[94123]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7118a916-f33a-4df3-99d6-fbc02f35ad65" returned: 0 in 0.807s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:24:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (884a146c-b85f-4e7f-ba2b-c96604de7f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7118a916-f33a-4df3-99d6-fbc02f35ad65', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360a52f8-1633-4daa-b2d6-73b5da9dc410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:45 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Volume volume-7118a916-f33a-4df3-99d6-fbc02f35ad65 (7118a916-f33a-4df3-99d6-fbc02f35ad65): created successfully Jul 07 17:24:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360a52f8-1633-4daa-b2d6-73b5da9dc410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Flow 'volume_create_manager' (fb00c5f1-121e-4b59-8f4b-283e5d4f5b9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:45 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-9007fc2e-0caa-49d9-89e4-398e77480584 tempest-VolumesTestJSON-1638446596 None] Created volume successfully. Jul 07 17:24:45 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dddceb0a-3ff2-4451-8743-3b8ac68b4cc6 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a" returned: 0 in 0.826s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dddceb0a-3ff2-4451-8743-3b8ac68b4cc6 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.a078a7a1-b3be-4e5d-a3cc-9bb013536e8c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:45 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.a078a7a1-b3be-4e5d-a3cc-9bb013536e8c Jul 07 17:24:45 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:46 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dddceb0a-3ff2-4451-8743-3b8ac68b4cc6 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.a078a7a1-b3be-4e5d-a3cc-9bb013536e8c" returned: 0 in 1.284s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dddceb0a-3ff2-4451-8743-3b8ac68b4cc6 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.a078a7a1-b3be-4e5d-a3cc-9bb013536e8c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:46 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.a078a7a1-b3be-4e5d-a3cc-9bb013536e8c Jul 07 17:24:46 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:47 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bf9c148c-de90-4797-9dcf-965ff8ca7165 tempest-VolumesTestJSON-1638446596 None] Acquiring lock "cinder-7118a916-f33a-4df3-99d6-fbc02f35ad65-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:47 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bf9c148c-de90-4797-9dcf-965ff8ca7165 tempest-VolumesTestJSON-1638446596 None] Lock "cinder-7118a916-f33a-4df3-99d6-fbc02f35ad65-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:47 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bf9c148c-de90-4797-9dcf-965ff8ca7165 tempest-VolumesTestJSON-1638446596 None] Acquiring lock "cinder-quobyte-7118a916-f33a-4df3-99d6-fbc02f35ad65" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:47 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bf9c148c-de90-4797-9dcf-965ff8ca7165 tempest-VolumesTestJSON-1638446596 None] Lock "cinder-quobyte-7118a916-f33a-4df3-99d6-fbc02f35ad65" acquired by "delete_volume" :: waited 0.022s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:47 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[2027cd15-810a-4854-b631-5daf5cf871e4]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bf9c148c-de90-4797-9dcf-965ff8ca7165 tempest-VolumesTestJSON-1638446596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7118a916-f33a-4df3-99d6-fbc02f35ad65 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:47 devstack sudo[94165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7118a916-f33a-4df3-99d6-fbc02f35ad65 Jul 07 17:24:47 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:47 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dddceb0a-3ff2-4451-8743-3b8ac68b4cc6 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a.a078a7a1-b3be-4e5d-a3cc-9bb013536e8c" returned: 0 in 1.095s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:47 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dddceb0a-3ff2-4451-8743-3b8ac68b4cc6 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Lock "cinder-quobyte-a078a7a1-b3be-4e5d-a3cc-9bb013536e8c" released by "_delete_snapshot" :: held 4.357s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:47 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dddceb0a-3ff2-4451-8743-3b8ac68b4cc6 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Lock "cinder-quobyte-3651dda8-f703-402d-94c4-9e08febb438a" released by "delete_snapshot" :: held 4.386s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:47 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-dddceb0a-3ff2-4451-8743-3b8ac68b4cc6 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Created reservations ['b1f610f0-0e6d-4e04-bf18-20106387d5a7', '4d22668c-93fe-4ad5-b784-6b7af36d8d25', '8434c863-82c0-442e-8ac2-7a6874c3ac0d', '922f8d5a-e5a8-4cdf-b530-7021b0a1b1e4'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:48 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-dddceb0a-3ff2-4451-8743-3b8ac68b4cc6 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Delete snapshot completed successfully. Jul 07 17:24:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dddceb0a-3ff2-4451-8743-3b8ac68b4cc6 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Lock "cinder-a078a7a1-b3be-4e5d-a3cc-9bb013536e8c-delete_snapshot" released by "delete_snapshot" :: held 4.586s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:48 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bf9c148c-de90-4797-9dcf-965ff8ca7165 tempest-VolumesTestJSON-1638446596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7118a916-f33a-4df3-99d6-fbc02f35ad65" returned: 0 in 1.021s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bf9c148c-de90-4797-9dcf-965ff8ca7165 tempest-VolumesTestJSON-1638446596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7118a916-f33a-4df3-99d6-fbc02f35ad65 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:48 devstack sudo[94172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7118a916-f33a-4df3-99d6-fbc02f35ad65 Jul 07 17:24:48 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-55e9dff6-eba5-4d77-8fba-76d33822fb10 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Acquiring lock "cinder-3651dda8-f703-402d-94c4-9e08febb438a-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-55e9dff6-eba5-4d77-8fba-76d33822fb10 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Lock "cinder-3651dda8-f703-402d-94c4-9e08febb438a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-55e9dff6-eba5-4d77-8fba-76d33822fb10 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Acquiring lock "cinder-quobyte-3651dda8-f703-402d-94c4-9e08febb438a" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-55e9dff6-eba5-4d77-8fba-76d33822fb10 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Lock "cinder-quobyte-3651dda8-f703-402d-94c4-9e08febb438a" acquired by "delete_volume" :: waited 0.017s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:48 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3b0c3f-593a-42a7-bded-1dd9cdcb5af8]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-55e9dff6-eba5-4d77-8fba-76d33822fb10 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:49 devstack sudo[94175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a Jul 07 17:24:49 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:49 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bf9c148c-de90-4797-9dcf-965ff8ca7165 tempest-VolumesTestJSON-1638446596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7118a916-f33a-4df3-99d6-fbc02f35ad65" returned: 0 in 0.755s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:49 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bf9c148c-de90-4797-9dcf-965ff8ca7165 tempest-VolumesTestJSON-1638446596 None] Lock "cinder-quobyte-7118a916-f33a-4df3-99d6-fbc02f35ad65" released by "delete_volume" :: held 1.837s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:49 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-bf9c148c-de90-4797-9dcf-965ff8ca7165 tempest-VolumesTestJSON-1638446596 None] Created reservations ['3491142b-4851-4f9e-b6e9-af3a245f4bbe', 'bed2e965-3fca-4a1e-9108-f834a665cdc3', '7ac3e7c9-5d57-4b28-b180-f689d74fd65c', '4f63c833-85d0-41c2-8fc7-b14e18ed04bd'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bf9c148c-de90-4797-9dcf-965ff8ca7165 tempest-VolumesTestJSON-1638446596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bf9c148c-de90-4797-9dcf-965ff8ca7165 tempest-VolumesTestJSON-1638446596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-bf9c148c-de90-4797-9dcf-965ff8ca7165 tempest-VolumesTestJSON-1638446596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-bf9c148c-de90-4797-9dcf-965ff8ca7165 tempest-VolumesTestJSON-1638446596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bf9c148c-de90-4797-9dcf-965ff8ca7165 tempest-VolumesTestJSON-1638446596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bf9c148c-de90-4797-9dcf-965ff8ca7165 tempest-VolumesTestJSON-1638446596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:49 devstack sudo[94177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:24:49 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:49 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ab05d955-2ea7-49e3-a92c-3f067c74fb45 tempest-VolumesTestJSON-1638446596 None] Acquiring lock "cinder-45f7c836-99cc-48e1-9104-1d0ee04b7e86-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:49 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ab05d955-2ea7-49e3-a92c-3f067c74fb45 tempest-VolumesTestJSON-1638446596 None] Lock "cinder-45f7c836-99cc-48e1-9104-1d0ee04b7e86-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:49 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ab05d955-2ea7-49e3-a92c-3f067c74fb45 tempest-VolumesTestJSON-1638446596 None] Acquiring lock "cinder-quobyte-45f7c836-99cc-48e1-9104-1d0ee04b7e86" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:49 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ab05d955-2ea7-49e3-a92c-3f067c74fb45 tempest-VolumesTestJSON-1638446596 None] Lock "cinder-quobyte-45f7c836-99cc-48e1-9104-1d0ee04b7e86" acquired by "delete_volume" :: waited 0.026s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:49 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97cc3e5-7ef3-4f32-aa9c-8a98812da12d]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ab05d955-2ea7-49e3-a92c-3f067c74fb45 tempest-VolumesTestJSON-1638446596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45f7c836-99cc-48e1-9104-1d0ee04b7e86 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:49 devstack sudo[94179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45f7c836-99cc-48e1-9104-1d0ee04b7e86 Jul 07 17:24:49 devstack sudo[94179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:49 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-55e9dff6-eba5-4d77-8fba-76d33822fb10 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a" returned: 0 in 0.857s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-55e9dff6-eba5-4d77-8fba-76d33822fb10 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:49 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a Jul 07 17:24:49 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:50 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bf9c148c-de90-4797-9dcf-965ff8ca7165 tempest-VolumesTestJSON-1638446596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.790s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:50 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-bf9c148c-de90-4797-9dcf-965ff8ca7165 tempest-VolumesTestJSON-1638446596 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:50 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-bf9c148c-de90-4797-9dcf-965ff8ca7165 tempest-VolumesTestJSON-1638446596 None] Deleted volume successfully. Jul 07 17:24:50 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bf9c148c-de90-4797-9dcf-965ff8ca7165 tempest-VolumesTestJSON-1638446596 None] Lock "cinder-7118a916-f33a-4df3-99d6-fbc02f35ad65-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:50 devstack sudo[94179]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ab05d955-2ea7-49e3-a92c-3f067c74fb45 tempest-VolumesTestJSON-1638446596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45f7c836-99cc-48e1-9104-1d0ee04b7e86" returned: 0 in 0.864s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ab05d955-2ea7-49e3-a92c-3f067c74fb45 tempest-VolumesTestJSON-1638446596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45f7c836-99cc-48e1-9104-1d0ee04b7e86 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:50 devstack sudo[94191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45f7c836-99cc-48e1-9104-1d0ee04b7e86 Jul 07 17:24:50 devstack sudo[94191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:50 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-55e9dff6-eba5-4d77-8fba-76d33822fb10 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3651dda8-f703-402d-94c4-9e08febb438a" returned: 0 in 0.820s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:50 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-55e9dff6-eba5-4d77-8fba-76d33822fb10 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Lock "cinder-quobyte-3651dda8-f703-402d-94c4-9e08febb438a" released by "delete_volume" :: held 1.750s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:50 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-55e9dff6-eba5-4d77-8fba-76d33822fb10 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Created reservations ['2af4e03e-aa7c-4750-bf97-fe6d80b56a66', '55f7996a-f312-4621-86d9-89d782e313e5', 'a184c8d5-46a5-4c36-a2fc-83ef802cb383', '65a86b45-f243-45ff-b520-8f5d4eaacb86'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-55e9dff6-eba5-4d77-8fba-76d33822fb10 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-55e9dff6-eba5-4d77-8fba-76d33822fb10 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-55e9dff6-eba5-4d77-8fba-76d33822fb10 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-55e9dff6-eba5-4d77-8fba-76d33822fb10 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-55e9dff6-eba5-4d77-8fba-76d33822fb10 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-55e9dff6-eba5-4d77-8fba-76d33822fb10 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:50 devstack sudo[94194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:24:50 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:51 devstack sudo[94191]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ab05d955-2ea7-49e3-a92c-3f067c74fb45 tempest-VolumesTestJSON-1638446596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-45f7c836-99cc-48e1-9104-1d0ee04b7e86" returned: 0 in 0.783s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ab05d955-2ea7-49e3-a92c-3f067c74fb45 tempest-VolumesTestJSON-1638446596 None] Lock "cinder-quobyte-45f7c836-99cc-48e1-9104-1d0ee04b7e86" released by "delete_volume" :: held 1.730s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:51 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-ab05d955-2ea7-49e3-a92c-3f067c74fb45 tempest-VolumesTestJSON-1638446596 None] Created reservations ['77011fcf-77e2-4d12-a723-80ff0106e166', '8d19e44e-34cf-46a8-8157-628f6e8493c1', '4db4d977-9da1-4382-b3d3-b002904268b7', '4c622027-155e-4f5c-9513-c9a7d0bc2e2d'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ab05d955-2ea7-49e3-a92c-3f067c74fb45 tempest-VolumesTestJSON-1638446596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ab05d955-2ea7-49e3-a92c-3f067c74fb45 tempest-VolumesTestJSON-1638446596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ab05d955-2ea7-49e3-a92c-3f067c74fb45 tempest-VolumesTestJSON-1638446596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ab05d955-2ea7-49e3-a92c-3f067c74fb45 tempest-VolumesTestJSON-1638446596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ab05d955-2ea7-49e3-a92c-3f067c74fb45 tempest-VolumesTestJSON-1638446596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ab05d955-2ea7-49e3-a92c-3f067c74fb45 tempest-VolumesTestJSON-1638446596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:51 devstack sudo[94198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:24:51 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:51 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-55e9dff6-eba5-4d77-8fba-76d33822fb10 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.746s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:51 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-55e9dff6-eba5-4d77-8fba-76d33822fb10 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:51 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-55e9dff6-eba5-4d77-8fba-76d33822fb10 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Deleted volume successfully. Jul 07 17:24:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-55e9dff6-eba5-4d77-8fba-76d33822fb10 tempest-VolumesSnapshotNegativeTestJSON-129125537 None] Lock "cinder-3651dda8-f703-402d-94c4-9e08febb438a-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-832bb76f-74a4-4c31-a3f1-a00f0b24fdfa tempest-VolumesTestJSON-1638446596 None] Acquiring lock "cinder-da9daea2-fe2b-4e15-a4ec-22b04ac64fd8-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-832bb76f-74a4-4c31-a3f1-a00f0b24fdfa tempest-VolumesTestJSON-1638446596 None] Lock "cinder-da9daea2-fe2b-4e15-a4ec-22b04ac64fd8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-832bb76f-74a4-4c31-a3f1-a00f0b24fdfa tempest-VolumesTestJSON-1638446596 None] Acquiring lock "cinder-quobyte-da9daea2-fe2b-4e15-a4ec-22b04ac64fd8" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:24:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-832bb76f-74a4-4c31-a3f1-a00f0b24fdfa tempest-VolumesTestJSON-1638446596 None] Lock "cinder-quobyte-da9daea2-fe2b-4e15-a4ec-22b04ac64fd8" acquired by "delete_volume" :: waited 0.030s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:24:51 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21b40ef-c03e-4abf-9b03-70c2b29d2401]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:24:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-832bb76f-74a4-4c31-a3f1-a00f0b24fdfa tempest-VolumesTestJSON-1638446596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da9daea2-fe2b-4e15-a4ec-22b04ac64fd8 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:52 devstack sudo[94200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da9daea2-fe2b-4e15-a4ec-22b04ac64fd8 Jul 07 17:24:52 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:52 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ab05d955-2ea7-49e3-a92c-3f067c74fb45 tempest-VolumesTestJSON-1638446596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.855s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:52 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-ab05d955-2ea7-49e3-a92c-3f067c74fb45 tempest-VolumesTestJSON-1638446596 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:52 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-ab05d955-2ea7-49e3-a92c-3f067c74fb45 tempest-VolumesTestJSON-1638446596 None] Deleted volume successfully. Jul 07 17:24:52 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ab05d955-2ea7-49e3-a92c-3f067c74fb45 tempest-VolumesTestJSON-1638446596 None] Lock "cinder-45f7c836-99cc-48e1-9104-1d0ee04b7e86-delete_volume" released by "delete_volume" :: held 2.896s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:53 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-832bb76f-74a4-4c31-a3f1-a00f0b24fdfa tempest-VolumesTestJSON-1638446596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da9daea2-fe2b-4e15-a4ec-22b04ac64fd8" returned: 0 in 1.186s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-832bb76f-74a4-4c31-a3f1-a00f0b24fdfa tempest-VolumesTestJSON-1638446596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da9daea2-fe2b-4e15-a4ec-22b04ac64fd8 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:53 devstack sudo[94212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da9daea2-fe2b-4e15-a4ec-22b04ac64fd8 Jul 07 17:24:53 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Flow 'volume_create_manager' (9aa2c2ae-61dd-4eb2-8444-1e4db8d5c725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d19a42a8-c67c-4ae4-90dd-6285a39e41e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d19a42a8-c67c-4ae4-90dd-6285a39e41e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2100165885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee23b85-1910-4529-8e7e-57f78490dca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba109cf167ff489080e77c314e5e0343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:53Z,use_quota=True,user_id='4088f72dbd774c3d8c29e00552631f08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b5f1ec-deaf-430e-93dd-f6ebd6dd4cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b5f1ec-deaf-430e-93dd-f6ebd6dd4cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695d03a8-73f2-4bde-9d78-047bdf8e7e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695d03a8-73f2-4bde-9d78-047bdf8e7e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cee23b85-1910-4529-8e7e-57f78490dca8', 'volume_name': 'volume-cee23b85-1910-4529-8e7e-57f78490dca8', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e9246e-ff32-4545-a507-fc9023a2f3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e9246e-ff32-4545-a507-fc9023a2f3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d9b6d7-05d2-41ce-977c-29447e44dbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:53 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Volume cee23b85-1910-4529-8e7e-57f78490dca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cee23b85-1910-4529-8e7e-57f78490dca8', 'volume_size': 1} Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2100165885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee23b85-1910-4529-8e7e-57f78490dca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba109cf167ff489080e77c314e5e0343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:24:53Z,use_quota=True,user_id='4088f72dbd774c3d8c29e00552631f08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Creating volume cee23b85-1910-4529-8e7e-57f78490dca8 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:24:53 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cee23b85-1910-4529-8e7e-57f78490dca8 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:53 devstack sudo[94220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cee23b85-1910-4529-8e7e-57f78490dca8 1073741824 Jul 07 17:24:53 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:53 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-832bb76f-74a4-4c31-a3f1-a00f0b24fdfa tempest-VolumesTestJSON-1638446596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da9daea2-fe2b-4e15-a4ec-22b04ac64fd8" returned: 0 in 0.827s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-832bb76f-74a4-4c31-a3f1-a00f0b24fdfa tempest-VolumesTestJSON-1638446596 None] Lock "cinder-quobyte-da9daea2-fe2b-4e15-a4ec-22b04ac64fd8" released by "delete_volume" :: held 2.117s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:54 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-832bb76f-74a4-4c31-a3f1-a00f0b24fdfa tempest-VolumesTestJSON-1638446596 None] Created reservations ['7b32c8fd-55c5-46d4-9312-79b08b9711bb', '933b705e-c003-4ec9-91e6-1ce2bd394acc', '71a1653d-5d1e-42fb-8937-c76f2a9d6230', '60441269-c12e-4ba2-ad8f-a46b18e30edd'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:24:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-832bb76f-74a4-4c31-a3f1-a00f0b24fdfa tempest-VolumesTestJSON-1638446596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-832bb76f-74a4-4c31-a3f1-a00f0b24fdfa tempest-VolumesTestJSON-1638446596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:54 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-832bb76f-74a4-4c31-a3f1-a00f0b24fdfa tempest-VolumesTestJSON-1638446596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:54 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-832bb76f-74a4-4c31-a3f1-a00f0b24fdfa tempest-VolumesTestJSON-1638446596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-832bb76f-74a4-4c31-a3f1-a00f0b24fdfa tempest-VolumesTestJSON-1638446596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-832bb76f-74a4-4c31-a3f1-a00f0b24fdfa tempest-VolumesTestJSON-1638446596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:54 devstack sudo[94223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:24:54 devstack sudo[94223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:54 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cee23b85-1910-4529-8e7e-57f78490dca8 1073741824" returned: 0 in 1.119s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cee23b85-1910-4529-8e7e-57f78490dca8 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:54 devstack sudo[94230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cee23b85-1910-4529-8e7e-57f78490dca8 Jul 07 17:24:54 devstack sudo[94230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:55 devstack sudo[94223]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-832bb76f-74a4-4c31-a3f1-a00f0b24fdfa tempest-VolumesTestJSON-1638446596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.870s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:55 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-832bb76f-74a4-4c31-a3f1-a00f0b24fdfa tempest-VolumesTestJSON-1638446596 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:55 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-832bb76f-74a4-4c31-a3f1-a00f0b24fdfa tempest-VolumesTestJSON-1638446596 None] Deleted volume successfully. Jul 07 17:24:55 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-832bb76f-74a4-4c31-a3f1-a00f0b24fdfa tempest-VolumesTestJSON-1638446596 None] Lock "cinder-da9daea2-fe2b-4e15-a4ec-22b04ac64fd8-delete_volume" released by "delete_volume" :: held 3.321s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:24:55 devstack sudo[94230]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cee23b85-1910-4529-8e7e-57f78490dca8" returned: 0 in 0.944s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:55 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] <== create_volume: return (2140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:24:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.142s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d9b6d7-05d2-41ce-977c-29447e44dbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cee23b85-1910-4529-8e7e-57f78490dca8', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5821bf88-cc54-45a6-b047-e3b51722fe18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:24:55 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Volume volume-cee23b85-1910-4529-8e7e-57f78490dca8 (cee23b85-1910-4529-8e7e-57f78490dca8): created successfully Jul 07 17:24:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5821bf88-cc54-45a6-b047-e3b51722fe18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:24:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Flow 'volume_create_manager' (9aa2c2ae-61dd-4eb2-8444-1e4db8d5c725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:24:55 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-773d3c2d-fc38-4820-870c-2059e1494274 tempest-AttachVolumeNegativeTest-1635603288 None] Created volume successfully. Jul 07 17:24:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:24:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:24:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:24:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:24:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:24:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:24:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:24:56 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:24:56 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:24:57 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Jul 07 17:24:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.684s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:24:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:24:57 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:24:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:24:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:25:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-8ed9eb1f-857f-4330-a571-3fea86c9374c req-5d7e3a80-dd1e-4b50-9c86-5a37452ff708 tempest-AttachVolumeNegativeTest-1635603288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-8ed9eb1f-857f-4330-a571-3fea86c9374c req-5d7e3a80-dd1e-4b50-9c86-5a37452ff708 tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:03 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc412447-d2ac-4758-975a-5b45678131f2]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-8ed9eb1f-857f-4330-a571-3fea86c9374c req-5d7e3a80-dd1e-4b50-9c86-5a37452ff708 tempest-AttachVolumeNegativeTest-1635603288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cee23b85-1910-4529-8e7e-57f78490dca8 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:03 devstack sudo[94253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cee23b85-1910-4529-8e7e-57f78490dca8 Jul 07 17:25:03 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:04 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-8ed9eb1f-857f-4330-a571-3fea86c9374c req-5d7e3a80-dd1e-4b50-9c86-5a37452ff708 tempest-AttachVolumeNegativeTest-1635603288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cee23b85-1910-4529-8e7e-57f78490dca8" returned: 0 in 1.371s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-8ed9eb1f-857f-4330-a571-3fea86c9374c req-5d7e3a80-dd1e-4b50-9c86-5a37452ff708 tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.416s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-8ed9eb1f-857f-4330-a571-3fea86c9374c req-5d7e3a80-dd1e-4b50-9c86-5a37452ff708 tempest-AttachVolumeNegativeTest-1635603288 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2', 'name': 'volume-cee23b85-1910-4529-8e7e-57f78490dca8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f80d0e35-ee23-4905-bdfe-4c6f6178e7ac', 'enforce_multipath': True} {{(pid=87303) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:25:05 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-8ed9eb1f-857f-4330-a571-3fea86c9374c req-5d7e3a80-dd1e-4b50-9c86-5a37452ff708 tempest-AttachVolumeNegativeTest-1635603288 None] attachment_update completed successfully. Jul 07 17:25:06 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b013c52a-6512-4810-8f38-345102c0300f tempest-GroupSnapshotsV319Test-499574765 None] Group tempest-GroupSnapshotsV319Test-Group-313641365: creating Jul 07 17:25:06 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=75,cinder:UPDATE=80,cinder:DELETE=6,cinder:INSERT=16 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:25:06 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b013c52a-6512-4810-8f38-345102c0300f tempest-GroupSnapshotsV319Test-499574765 None] Group tempest-GroupSnapshotsV319Test-Group-313641365: created successfully Jul 07 17:25:06 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b013c52a-6512-4810-8f38-345102c0300f tempest-GroupSnapshotsV319Test-499574765 None] Create group completed successfully. Jul 07 17:25:08 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:25:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Flow 'volume_create_manager' (7af077f8-2740-486f-912e-52368859a11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c41d0d-f6fc-40b9-b368-14156ca5e44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:08 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:UPDATE=85,cinder:DELETE=8,cinder:SELECT=68,cinder:INSERT=22 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:25:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c41d0d-f6fc-40b9-b368-14156ca5e44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1375247564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=12015ec8-acba-476f-bab1-6a520c0953ab,host='devstack@QuobyteHD#QuobyteHD',id=c9109f8e-4edb-41f0-a4c4-1cef6c38ef99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d098971e842e47d38de5dd84add25ef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:08Z,use_quota=True,user_id='223038cf87864633b850591439232645',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2486fc24-ae09-4d02-aec9-1dd87a481a8d),volume_type_id=2486fc24-ae09-4d02-aec9-1dd87a481a8d)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ff4ab9f-36e5-481f-8fa5-8bfaeae7865d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ff4ab9f-36e5-481f-8fa5-8bfaeae7865d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dc014a1-85de-4a2e-96c7-2dfa26468a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dc014a1-85de-4a2e-96c7-2dfa26468a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9109f8e-4edb-41f0-a4c4-1cef6c38ef99', 'volume_name': 'volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb855e8-ad0f-4bc0-85b5-8f756348ff62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb855e8-ad0f-4bc0-85b5-8f756348ff62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfbc0df-4c95-4a57-a3cb-cef78e962eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:08 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Volume c9109f8e-4edb-41f0-a4c4-1cef6c38ef99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99', 'volume_size': 1} Jul 07 17:25:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=12015ec8-acba-476f-bab1-6a520c0953ab,created_at=2026-07-07T15:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1375247564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=12015ec8-acba-476f-bab1-6a520c0953ab,host='devstack@QuobyteHD#QuobyteHD',id=c9109f8e-4edb-41f0-a4c4-1cef6c38ef99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d098971e842e47d38de5dd84add25ef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:08Z,use_quota=True,user_id='223038cf87864633b850591439232645',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2486fc24-ae09-4d02-aec9-1dd87a481a8d),volume_type_id=2486fc24-ae09-4d02-aec9-1dd87a481a8d)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:25:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Creating volume c9109f8e-4edb-41f0-a4c4-1cef6c38ef99 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:25:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:25:08 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:25:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:08 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99 1073741824 Jul 07 17:25:08 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:09 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99 1073741824" returned: 0 in 1.328s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:10 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99 Jul 07 17:25:10 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:11 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99" returned: 0 in 1.144s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] <== create_volume: return (2573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:25:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.577s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfbc0df-4c95-4a57-a3cb-cef78e962eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c5bfe5-dd00-46b2-8334-cf219303e8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:11 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Volume volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99 (c9109f8e-4edb-41f0-a4c4-1cef6c38ef99): created successfully Jul 07 17:25:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c5bfe5-dd00-46b2-8334-cf219303e8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Flow 'volume_create_manager' (7af077f8-2740-486f-912e-52368859a11d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:11 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-41615d22-0b90-4998-88df-4d68003664a3 tempest-GroupSnapshotsV319Test-499574765 None] Created volume successfully. Jul 07 17:25:12 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-4c9a0152-a9d2-4464-b209-20b97e4f268a tempest-GroupSnapshotsV319Test-499574765 None] GroupSnapshot b59670de-bc0c-4aaa-b2c3-dc9a3e4a823a: creating. Jul 07 17:25:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4c9a0152-a9d2-4464-b209-20b97e4f268a tempest-GroupSnapshotsV319Test-499574765 None] Group snapshot b59670de-bc0c-4aaa-b2c3-dc9a3e4a823a: creating. {{(pid=87303) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 17:25:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4c9a0152-a9d2-4464-b209-20b97e4f268a tempest-GroupSnapshotsV319Test-499574765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4c9a0152-a9d2-4464-b209-20b97e4f268a tempest-GroupSnapshotsV319Test-499574765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-4c9a0152-a9d2-4464-b209-20b97e4f268a tempest-GroupSnapshotsV319Test-499574765 None] Creating offline snapshot c3464a48-5971-49e9-b294-db356824bac7 of volume c9109f8e-4edb-41f0-a4c4-1cef6c38ef99 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:25:13 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d08ef29-ad1c-4769-833c-41d5c3f14800]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4c9a0152-a9d2-4464-b209-20b97e4f268a tempest-GroupSnapshotsV319Test-499574765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:13 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99 Jul 07 17:25:13 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:15 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4c9a0152-a9d2-4464-b209-20b97e4f268a tempest-GroupSnapshotsV319Test-499574765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99" returned: 0 in 2.270s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4c9a0152-a9d2-4464-b209-20b97e4f268a tempest-GroupSnapshotsV319Test-499574765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.c3464a48-5971-49e9-b294-db356824bac7 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:15 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.c3464a48-5971-49e9-b294-db356824bac7 1G Jul 07 17:25:15 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:16 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9af5d341-73cd-43c6-8977-f5987a578839 tempest-VolumesActionsTest-1833333682 None] Acquiring lock "cinder-6e0b7e85-88cd-4828-9cb7-25166eafc3b0" by "attach_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:16 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9af5d341-73cd-43c6-8977-f5987a578839 tempest-VolumesActionsTest-1833333682 None] Lock "cinder-6e0b7e85-88cd-4828-9cb7-25166eafc3b0" acquired by "attach_volume" :: waited 0.052s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:16 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-9af5d341-73cd-43c6-8977-f5987a578839 tempest-VolumesActionsTest-1833333682 None] Attaching volume 6e0b7e85-88cd-4828-9cb7-25166eafc3b0 to instance 4b0a42a7-801b-4ae6-994e-c356716b312e at mountpoint /dev/vdb on host None. Jul 07 17:25:16 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-9af5d341-73cd-43c6-8977-f5987a578839 tempest-VolumesActionsTest-1833333682 None] Attach volume completed successfully. Jul 07 17:25:16 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9af5d341-73cd-43c6-8977-f5987a578839 tempest-VolumesActionsTest-1833333682 None] Lock "cinder-6e0b7e85-88cd-4828-9cb7-25166eafc3b0" released by "attach_volume" :: held 0.272s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:16 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:16 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-31d1ad84-ad2c-41d4-ab07-a478e6fa9eba tempest-VolumesActionsTest-1833333682 None] Acquiring lock "cinder-6e0b7e85-88cd-4828-9cb7-25166eafc3b0-detach_volume" by "detach_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4c9a0152-a9d2-4464-b209-20b97e4f268a tempest-GroupSnapshotsV319Test-499574765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.c3464a48-5971-49e9-b294-db356824bac7 1G" returned: 0 in 1.590s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4c9a0152-a9d2-4464-b209-20b97e4f268a tempest-GroupSnapshotsV319Test-499574765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.c3464a48-5971-49e9-b294-db356824bac7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-31d1ad84-ad2c-41d4-ab07-a478e6fa9eba tempest-VolumesActionsTest-1833333682 None] Lock "cinder-6e0b7e85-88cd-4828-9cb7-25166eafc3b0-detach_volume" acquired by "detach_volume" :: waited 0.066s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:17 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-31d1ad84-ad2c-41d4-ab07-a478e6fa9eba tempest-VolumesActionsTest-1833333682 None] Detaching volume 6e0b7e85-88cd-4828-9cb7-25166eafc3b0 from instance 4b0a42a7-801b-4ae6-994e-c356716b312e. Jul 07 17:25:17 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.c3464a48-5971-49e9-b294-db356824bac7 Jul 07 17:25:17 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:17 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-31d1ad84-ad2c-41d4-ab07-a478e6fa9eba tempest-VolumesActionsTest-1833333682 None] Detach volume completed successfully. Jul 07 17:25:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-31d1ad84-ad2c-41d4-ab07-a478e6fa9eba tempest-VolumesActionsTest-1833333682 None] Lock "cinder-6e0b7e85-88cd-4828-9cb7-25166eafc3b0-detach_volume" released by "detach_volume" :: held 0.196s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:18 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4c9a0152-a9d2-4464-b209-20b97e4f268a tempest-GroupSnapshotsV319Test-499574765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.c3464a48-5971-49e9-b294-db356824bac7" returned: 0 in 1.400s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:18 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-4c9a0152-a9d2-4464-b209-20b97e4f268a tempest-GroupSnapshotsV319Test-499574765 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.c3464a48-5971-49e9-b294-db356824bac7 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:25:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4c9a0152-a9d2-4464-b209-20b97e4f268a tempest-GroupSnapshotsV319Test-499574765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.c3464a48-5971-49e9-b294-db356824bac7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:18 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.c3464a48-5971-49e9-b294-db356824bac7 Jul 07 17:25:18 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:19 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4c9a0152-a9d2-4464-b209-20b97e4f268a tempest-GroupSnapshotsV319Test-499574765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.c3464a48-5971-49e9-b294-db356824bac7" returned: 0 in 0.942s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4c9a0152-a9d2-4464-b209-20b97e4f268a tempest-GroupSnapshotsV319Test-499574765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:19 devstack sudo[95187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.info Jul 07 17:25:19 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:20 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4c9a0152-a9d2-4464-b209-20b97e4f268a tempest-GroupSnapshotsV319Test-499574765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.info" returned: 0 in 1.091s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:20 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-4c9a0152-a9d2-4464-b209-20b97e4f268a tempest-GroupSnapshotsV319Test-499574765 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:25:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4c9a0152-a9d2-4464-b209-20b97e4f268a tempest-GroupSnapshotsV319Test-499574765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:20 devstack sudo[95207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.info Jul 07 17:25:20 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:21 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4c9a0152-a9d2-4464-b209-20b97e4f268a tempest-GroupSnapshotsV319Test-499574765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.info" returned: 0 in 1.005s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4c9a0152-a9d2-4464-b209-20b97e4f268a tempest-GroupSnapshotsV319Test-499574765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.455s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:21 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-4c9a0152-a9d2-4464-b209-20b97e4f268a tempest-GroupSnapshotsV319Test-499574765 None] group_snapshot b59670de-bc0c-4aaa-b2c3-dc9a3e4a823a: created successfully Jul 07 17:25:23 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-023feb02-8b6f-446f-87fa-67432d54c60e tempest-GroupSnapshotsV319Test-499574765 None] group_snapshot b59670de-bc0c-4aaa-b2c3-dc9a3e4a823a: deleting Jul 07 17:25:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-023feb02-8b6f-446f-87fa-67432d54c60e tempest-GroupSnapshotsV319Test-499574765 None] group_snapshot b59670de-bc0c-4aaa-b2c3-dc9a3e4a823a: deleting {{(pid=87303) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 17:25:23 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-023feb02-8b6f-446f-87fa-67432d54c60e tempest-GroupSnapshotsV319Test-499574765 None] Acquiring lock "cinder-quobyte-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:23 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-023feb02-8b6f-446f-87fa-67432d54c60e tempest-GroupSnapshotsV319Test-499574765 None] Lock "cinder-quobyte-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:23 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-023feb02-8b6f-446f-87fa-67432d54c60e tempest-GroupSnapshotsV319Test-499574765 None] Acquiring lock "cinder-quobyte-c3464a48-5971-49e9-b294-db356824bac7" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:23 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-023feb02-8b6f-446f-87fa-67432d54c60e tempest-GroupSnapshotsV319Test-499574765 None] Lock "cinder-quobyte-c3464a48-5971-49e9-b294-db356824bac7" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:23 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-023feb02-8b6f-446f-87fa-67432d54c60e tempest-GroupSnapshotsV319Test-499574765 None] Deleting offline snapshot c3464a48-5971-49e9-b294-db356824bac7 of volume c9109f8e-4edb-41f0-a4c4-1cef6c38ef99 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:25:23 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-023feb02-8b6f-446f-87fa-67432d54c60e tempest-GroupSnapshotsV319Test-499574765 None] snapshot_file for this snap is: volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.c3464a48-5971-49e9-b294-db356824bac7 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:25:23 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[1137173f-dbc8-4f42-a7eb-a2ffe2827bb6]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-023feb02-8b6f-446f-87fa-67432d54c60e tempest-GroupSnapshotsV319Test-499574765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.c3464a48-5971-49e9-b294-db356824bac7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:23 devstack sudo[95215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.c3464a48-5971-49e9-b294-db356824bac7 Jul 07 17:25:23 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:24 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-023feb02-8b6f-446f-87fa-67432d54c60e tempest-GroupSnapshotsV319Test-499574765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.c3464a48-5971-49e9-b294-db356824bac7" returned: 0 in 1.062s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:24 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-023feb02-8b6f-446f-87fa-67432d54c60e tempest-GroupSnapshotsV319Test-499574765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:25:24 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[234b9f1f-a22a-4d35-9f1e-a26559ca273d]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-023feb02-8b6f-446f-87fa-67432d54c60e tempest-GroupSnapshotsV319Test-499574765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:24 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99 Jul 07 17:25:24 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:25 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-023feb02-8b6f-446f-87fa-67432d54c60e tempest-GroupSnapshotsV319Test-499574765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99" returned: 0 in 1.266s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-023feb02-8b6f-446f-87fa-67432d54c60e tempest-GroupSnapshotsV319Test-499574765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.c3464a48-5971-49e9-b294-db356824bac7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:25 devstack sudo[95249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.c3464a48-5971-49e9-b294-db356824bac7 Jul 07 17:25:25 devstack sudo[95249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:26 devstack sudo[95249]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-023feb02-8b6f-446f-87fa-67432d54c60e tempest-GroupSnapshotsV319Test-499574765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.c3464a48-5971-49e9-b294-db356824bac7" returned: 0 in 1.058s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-023feb02-8b6f-446f-87fa-67432d54c60e tempest-GroupSnapshotsV319Test-499574765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.c3464a48-5971-49e9-b294-db356824bac7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:27 devstack sudo[95268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.c3464a48-5971-49e9-b294-db356824bac7 Jul 07 17:25:27 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:27 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-023feb02-8b6f-446f-87fa-67432d54c60e tempest-GroupSnapshotsV319Test-499574765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99.c3464a48-5971-49e9-b294-db356824bac7" returned: 0 in 0.783s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-023feb02-8b6f-446f-87fa-67432d54c60e tempest-GroupSnapshotsV319Test-499574765 None] Lock "cinder-quobyte-c3464a48-5971-49e9-b294-db356824bac7" released by "_delete_snapshot" :: held 4.361s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-023feb02-8b6f-446f-87fa-67432d54c60e tempest-GroupSnapshotsV319Test-499574765 None] Lock "cinder-quobyte-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99" released by "delete_snapshot" :: held 4.421s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:28 devstack cinder-volume[87303]: WARNING cinder.quota [None req-023feb02-8b6f-446f-87fa-67432d54c60e tempest-GroupSnapshotsV319Test-499574765 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-813289694 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-813289694, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:25:28 devstack cinder-volume[87303]: WARNING cinder.quota [None req-023feb02-8b6f-446f-87fa-67432d54c60e tempest-GroupSnapshotsV319Test-499574765 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-813289694 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-813289694, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:25:28 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-023feb02-8b6f-446f-87fa-67432d54c60e tempest-GroupSnapshotsV319Test-499574765 None] Created reservations ['a1f67131-43cb-4c56-b325-8999c88124e8', '475eb7e2-91c4-4a97-9a73-514180ddac80', '61b26144-b31c-4e54-b63b-121cbbde5b15', 'a567f9ce-27da-429c-b283-8f2120c4b13e'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:25:31 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-023feb02-8b6f-446f-87fa-67432d54c60e tempest-GroupSnapshotsV319Test-499574765 None] group_snapshot b59670de-bc0c-4aaa-b2c3-dc9a3e4a823a: deleted successfully Jul 07 17:25:32 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ab7b145a-f9d5-48d7-bff2-8b88e039903e tempest-GroupSnapshotsV319Test-499574765 None] Acquiring lock "cinder-quobyte-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:25:32 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ab7b145a-f9d5-48d7-bff2-8b88e039903e tempest-GroupSnapshotsV319Test-499574765 None] Lock "cinder-quobyte-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99" acquired by "delete_volume" :: waited 0.059s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:25:32 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcc5260-9e66-4ccb-86d5-70ef03771fdf]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ab7b145a-f9d5-48d7-bff2-8b88e039903e tempest-GroupSnapshotsV319Test-499574765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:32 devstack sudo[95276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99 Jul 07 17:25:32 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:33 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ab7b145a-f9d5-48d7-bff2-8b88e039903e tempest-GroupSnapshotsV319Test-499574765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99" returned: 0 in 1.062s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ab7b145a-f9d5-48d7-bff2-8b88e039903e tempest-GroupSnapshotsV319Test-499574765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:33 devstack sudo[95281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99 Jul 07 17:25:33 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-57026445-7506-445d-b75f-03ab3fc9775d tempest-VolumesActionsTest-1833333682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-57026445-7506-445d-b75f-03ab3fc9775d tempest-VolumesActionsTest-1833333682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:33 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a7df24-2496-4ab0-a427-ca116606d693]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-57026445-7506-445d-b75f-03ab3fc9775d tempest-VolumesActionsTest-1833333682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:33 devstack sudo[95283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 Jul 07 17:25:33 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:34 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ab7b145a-f9d5-48d7-bff2-8b88e039903e tempest-GroupSnapshotsV319Test-499574765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99" returned: 0 in 0.926s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ab7b145a-f9d5-48d7-bff2-8b88e039903e tempest-GroupSnapshotsV319Test-499574765 None] Lock "cinder-quobyte-c9109f8e-4edb-41f0-a4c4-1cef6c38ef99" released by "delete_volume" :: held 2.116s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:25:34 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-57026445-7506-445d-b75f-03ab3fc9775d tempest-VolumesActionsTest-1833333682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0" returned: 0 in 0.991s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:34 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-ab7b145a-f9d5-48d7-bff2-8b88e039903e tempest-GroupSnapshotsV319Test-499574765 None] Created reservations ['39196326-54e8-48e8-aae4-fd193db2dcc8'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:25:34 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f770a0-6ecb-466a-8831-def37c87fd53]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-57026445-7506-445d-b75f-03ab3fc9775d tempest-VolumesActionsTest-1833333682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:34 devstack cinder-volume[87303]: WARNING cinder.quota [None req-ab7b145a-f9d5-48d7-bff2-8b88e039903e tempest-GroupSnapshotsV319Test-499574765 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-813289694 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-813289694, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:25:34 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-ab7b145a-f9d5-48d7-bff2-8b88e039903e tempest-GroupSnapshotsV319Test-499574765 None] Created reservations ['7107a620-d5fe-48ca-911a-31a5498ce07e', 'eea7c060-4fc2-4f65-9e21-7e4a8197b3b1', '5e08b6d3-6180-49d6-9661-99a1c1ffb0cb', 'c47304ea-771e-4c4c-a517-ec77b4fc7aa5'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:25:34 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 Jul 07 17:25:34 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ab7b145a-f9d5-48d7-bff2-8b88e039903e tempest-GroupSnapshotsV319Test-499574765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ab7b145a-f9d5-48d7-bff2-8b88e039903e tempest-GroupSnapshotsV319Test-499574765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:35 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ab7b145a-f9d5-48d7-bff2-8b88e039903e tempest-GroupSnapshotsV319Test-499574765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:35 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ab7b145a-f9d5-48d7-bff2-8b88e039903e tempest-GroupSnapshotsV319Test-499574765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ab7b145a-f9d5-48d7-bff2-8b88e039903e tempest-GroupSnapshotsV319Test-499574765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ab7b145a-f9d5-48d7-bff2-8b88e039903e tempest-GroupSnapshotsV319Test-499574765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:35 devstack sudo[95291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:25:35 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:35 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-57026445-7506-445d-b75f-03ab3fc9775d tempest-VolumesActionsTest-1833333682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0" returned: 0 in 1.170s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-57026445-7506-445d-b75f-03ab3fc9775d tempest-VolumesActionsTest-1833333682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 /opt/stack/data/cinder/conversion/6e0b7e85-88cd-4828-9cb7-25166eafc3b0.temp_image.652478bf-c1c7-4c25-b7bc-9e307f9710bdy3lm6j2a.img {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:35 devstack sudo[95297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 /opt/stack/data/cinder/conversion/6e0b7e85-88cd-4828-9cb7-25166eafc3b0.temp_image.652478bf-c1c7-4c25-b7bc-9e307f9710bdy3lm6j2a.img Jul 07 17:25:35 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ab7b145a-f9d5-48d7-bff2-8b88e039903e tempest-GroupSnapshotsV319Test-499574765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.037s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:36 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-ab7b145a-f9d5-48d7-bff2-8b88e039903e tempest-GroupSnapshotsV319Test-499574765 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:25:36 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:36 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-ab7b145a-f9d5-48d7-bff2-8b88e039903e tempest-GroupSnapshotsV319Test-499574765 None] Delete group completed successfully. Jul 07 17:25:37 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:25:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Flow 'volume_create_manager' (d6ed189e-0e06-4bf4-aa73-10738b5c6924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0432f5e3-fc0c-4291-b9ed-82f5d2f85520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0432f5e3-fc0c-4291-b9ed-82f5d2f85520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-203988957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5200c5ee-e648-4843-9696-dea29b0ed66c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc75cf427e84c178ac5532d6fa529b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:37Z,use_quota=True,user_id='2f771809e3d04eb6bb8b90eb364a4d30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5568562a-4ceb-4d79-88ae-884b0bb88e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5568562a-4ceb-4d79-88ae-884b0bb88e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce48836b-1227-4624-821b-1d27e9b16cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:37 devstack cinder-volume[87303]: DEBUG cinder.image.glance [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Creating Keystone auth plugin from conf {{(pid=87303) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:25:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce48836b-1227-4624-821b-1d27e9b16cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5200c5ee-e648-4843-9696-dea29b0ed66c', 'volume_name': 'volume-5200c5ee-e648-4843-9696-dea29b0ed66c', 'volume_size': 1, 'image_id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '209334a192ee4ec7a4a563a01fc9db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/919a0971-57b8-4ecd-833d-de05e9b603e2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cafa3e5-8161-4219-b963-ea5796fcd9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cafa3e5-8161-4219-b963-ea5796fcd9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f92b197-4ce4-4b75-a780-0b96d5eefd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:39 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Volume 5200c5ee-e648-4843-9696-dea29b0ed66c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5200c5ee-e648-4843-9696-dea29b0ed66c', 'volume_size': 1, 'image_id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '209334a192ee4ec7a4a563a01fc9db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/919a0971-57b8-4ecd-833d-de05e9b603e2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 17:25:39 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Trying to clone 5200c5ee-e648-4843-9696-dea29b0ed66c from image 919a0971-57b8-4ecd-833d-de05e9b603e2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}]). {{(pid=87303) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:25:40 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_bdx7kyipdevstack@QuobyteHD, size 20.69 MB, duration 1.53 sec {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:25:40 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Image download 20.69 MB at 13.48 MB/s Jul 07 17:25:41 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[08897e55-6bb7-402b-9029-52e74cd523a7]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_bdx7kyipdevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:41 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_bdx7kyipdevstack@QuobyteHD Jul 07 17:25:41 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:42 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_bdx7kyipdevstack@QuobyteHD" returned: 0 in 1.639s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:42 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Temporary image 919a0971-57b8-4ecd-833d-de05e9b603e2 is fetched for user 2f771809e3d04eb6bb8b90eb364a4d30. {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:25:43 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01ea1a8-d85d-4cdb-8ede-c9a1a0ed99e5]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_bdx7kyipdevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:43 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_bdx7kyipdevstack@QuobyteHD Jul 07 17:25:43 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-57026445-7506-445d-b75f-03ab3fc9775d tempest-VolumesActionsTest-1833333682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 /opt/stack/data/cinder/conversion/6e0b7e85-88cd-4828-9cb7-25166eafc3b0.temp_image.652478bf-c1c7-4c25-b7bc-9e307f9710bdy3lm6j2a.img" returned: 0 in 9.115s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:45 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[debbf0e9-378e-4e15-b431-677942ecf7e7]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:25:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-57026445-7506-445d-b75f-03ab3fc9775d tempest-VolumesActionsTest-1833333682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:45 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 Jul 07 17:25:45 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:45 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_bdx7kyipdevstack@QuobyteHD" returned: 0 in 2.313s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:46 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-57026445-7506-445d-b75f-03ab3fc9775d tempest-VolumesActionsTest-1833333682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0" returned: 0 in 1.241s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:46 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-57026445-7506-445d-b75f-03ab3fc9775d tempest-VolumesActionsTest-1833333682 None] Image conversion details: src /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0, size 1024.00 MB, duration 9.12 sec, destination /opt/stack/data/cinder/conversion/6e0b7e85-88cd-4828-9cb7-25166eafc3b0.temp_image.652478bf-c1c7-4c25-b7bc-9e307f9710bdy3lm6j2a.img {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:25:46 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-57026445-7506-445d-b75f-03ab3fc9775d tempest-VolumesActionsTest-1833333682 None] Converted 1024.00 MB image at 112.31 MB/s Jul 07 17:25:46 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-57026445-7506-445d-b75f-03ab3fc9775d tempest-VolumesActionsTest-1833333682 None] 652478bf-c1c7-4c25-b7bc-9e307f9710bd was raw, no need to convert to raw {{(pid=87303) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 07 17:25:53 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=31,cinder:UPDATE=25,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:25:55 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:25:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Flow 'volume_create_manager' (5c2dc6b5-82a8-4ba7-bb9c-4c77f580c2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:25:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e261ac-0c1f-4f2c-abca-538fe47f7830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e261ac-0c1f-4f2c-abca-538fe47f7830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1977900764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8754e0fc-bc1c-4b41-b8e5-b6d65729e63a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6797d9b0a1094cac8d0a9d97973f75ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:56Z,use_quota=True,user_id='85ec1dd14ac04540bce5a4bf265ee082',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ffe44e5-200b-4ddc-82a5-12be79b2a026),volume_type_id=5ffe44e5-200b-4ddc-82a5-12be79b2a026)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d3183cb-ee86-430c-84ff-c5dc7b6e12bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d3183cb-ee86-430c-84ff-c5dc7b6e12bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:56 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ba96d1-d58c-4b83-9e52-3498c8045911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:56 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ba96d1-d58c-4b83-9e52-3498c8045911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8754e0fc-bc1c-4b41-b8e5-b6d65729e63a', 'volume_name': 'volume-8754e0fc-bc1c-4b41-b8e5-b6d65729e63a', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:56 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (580eba7f-6661-40ba-b901-c32688d660c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:56 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (580eba7f-6661-40ba-b901-c32688d660c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:25:56 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ff4b6a-00cc-47cf-bd0c-c6f5e3f4f5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:25:56 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Volume 8754e0fc-bc1c-4b41-b8e5-b6d65729e63a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8754e0fc-bc1c-4b41-b8e5-b6d65729e63a', 'volume_size': 1} Jul 07 17:25:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:25:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:25:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:25:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:25:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:25:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:25:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:25:56 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:25:56 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:25:57 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Jul 07 17:25:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.759s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:25:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:25:57 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:25:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:25:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:26:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-57026445-7506-445d-b75f-03ab3fc9775d tempest-VolumesActionsTest-1833333682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.198s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-57026445-7506-445d-b75f-03ab3fc9775d tempest-VolumesActionsTest-1833333682 None] Uploaded volume to glance image-id: 652478bf-c1c7-4c25-b7bc-9e307f9710bd. {{(pid=87303) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 17:26:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.614s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-203988957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5200c5ee-e648-4843-9696-dea29b0ed66c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc75cf427e84c178ac5532d6fa529b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:37Z,use_quota=True,user_id='2f771809e3d04eb6bb8b90eb364a4d30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:26:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Creating volume 5200c5ee-e648-4843-9696-dea29b0ed66c {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:26:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:26:07 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:26:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:08 devstack sudo[95470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c 1073741824 Jul 07 17:26:08 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:08 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-57026445-7506-445d-b75f-03ab3fc9775d tempest-VolumesActionsTest-1833333682 None] Copy volume to image completed successfully. Jul 07 17:26:09 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c 1073741824" returned: 0 in 1.328s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:09 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=36,cinder:UPDATE=28,cinder:INSERT=6 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:26:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:09 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c Jul 07 17:26:09 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:10 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c" returned: 0 in 0.895s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] <== create_volume: return (2310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:26:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.313s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.249s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1977900764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8754e0fc-bc1c-4b41-b8e5-b6d65729e63a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6797d9b0a1094cac8d0a9d97973f75ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:25:56Z,use_quota=True,user_id='85ec1dd14ac04540bce5a4bf265ee082',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ffe44e5-200b-4ddc-82a5-12be79b2a026),volume_type_id=5ffe44e5-200b-4ddc-82a5-12be79b2a026)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:26:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Creating volume 8754e0fc-bc1c-4b41-b8e5-b6d65729e63a {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:26:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:26:10 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:26:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8754e0fc-bc1c-4b41-b8e5-b6d65729e63a 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:10 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8754e0fc-bc1c-4b41-b8e5-b6d65729e63a 1073741824 Jul 07 17:26:10 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:10 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Attempting download of 919a0971-57b8-4ecd-833d-de05e9b603e2 ((None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}])) to volume 5200c5ee-e648-4843-9696-dea29b0ed66c. {{(pid=87303) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:26:10 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfc5d94-1000-482b-8a9f-ac2aae0abb5f]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_4nptdrbw {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:10 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_4nptdrbw Jul 07 17:26:10 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:11 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_4nptdrbw" returned: 0 in 0.815s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_4nptdrbw {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:11 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_4nptdrbw Jul 07 17:26:11 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:11 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8754e0fc-bc1c-4b41-b8e5-b6d65729e63a 1073741824" returned: 0 in 1.115s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8754e0fc-bc1c-4b41-b8e5-b6d65729e63a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:11 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8754e0fc-bc1c-4b41-b8e5-b6d65729e63a Jul 07 17:26:11 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:12 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_4nptdrbw" returned: 1 in 0.804s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_4nptdrbw' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:26:12 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[fceeeaf9-98ae-4afa-abb7-e0d80659c123]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_bdx7kyipdevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:12 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:12 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_bdx7kyipdevstack@QuobyteHD Jul 07 17:26:12 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8754e0fc-bc1c-4b41-b8e5-b6d65729e63a" returned: 0 in 0.781s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] <== create_volume: return (1943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:26:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.889s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:12 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41cbbb1-ccea-4de4-b6ec-ca8ea57d6b91]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ff4b6a-00cc-47cf-bd0c-c6f5e3f4f5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8754e0fc-bc1c-4b41-b8e5-b6d65729e63a', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b10f70-8f46-4232-ba4a-2cda5cccd73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:12 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Volume volume-8754e0fc-bc1c-4b41-b8e5-b6d65729e63a (8754e0fc-bc1c-4b41-b8e5-b6d65729e63a): created successfully Jul 07 17:26:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b10f70-8f46-4232-ba4a-2cda5cccd73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Flow 'volume_create_manager' (5c2dc6b5-82a8-4ba7-bb9c-4c77f580c2e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:12 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-aa9bff91-1901-44fb-8924-bc9c753d471c tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Created volume successfully. Jul 07 17:26:12 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 Jul 07 17:26:12 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:12 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_bdx7kyipdevstack@QuobyteHD" returned: 0 in 0.809s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:12 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] 919a0971-57b8-4ecd-833d-de05e9b603e2 was qcow2, converting to raw {{(pid=87303) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:26:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_bdx7kyipdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:12 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_bdx7kyipdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c Jul 07 17:26:12 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:13 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0" returned: 0 in 0.924s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:13 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[134e14a0-e4a6-41ce-913c-3300c8998909]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:13 devstack sudo[95541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 Jul 07 17:26:13 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bcadb2b4-5491-4f18-8d3f-ef329915b047 tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bcadb2b4-5491-4f18-8d3f-ef329915b047 tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-bcadb2b4-5491-4f18-8d3f-ef329915b047 tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-bcadb2b4-5491-4f18-8d3f-ef329915b047 tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bcadb2b4-5491-4f18-8d3f-ef329915b047 tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bcadb2b4-5491-4f18-8d3f-ef329915b047 tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:13 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:26:13 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:14 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0" returned: 0 in 0.899s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 /opt/stack/data/cinder/conversion/6e0b7e85-88cd-4828-9cb7-25166eafc3b0.temp_image.9514ecad-33aa-4540-9eea-92fd6f579cben2g8w9wx.img {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:14 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 /opt/stack/data/cinder/conversion/6e0b7e85-88cd-4828-9cb7-25166eafc3b0.temp_image.9514ecad-33aa-4540-9eea-92fd6f579cben2g8w9wx.img Jul 07 17:26:14 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:14 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bcadb2b4-5491-4f18-8d3f-ef329915b047 tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.829s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:14 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-bcadb2b4-5491-4f18-8d3f-ef329915b047 tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:14 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-bcadb2b4-5491-4f18-8d3f-ef329915b047 tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Retype volume completed successfully. Jul 07 17:26:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ff2a8f71-f018-4bf1-b90c-3ef50e3e82dc tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Acquiring lock "cinder-8754e0fc-bc1c-4b41-b8e5-b6d65729e63a-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ff2a8f71-f018-4bf1-b90c-3ef50e3e82dc tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Lock "cinder-8754e0fc-bc1c-4b41-b8e5-b6d65729e63a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ff2a8f71-f018-4bf1-b90c-3ef50e3e82dc tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Acquiring lock "cinder-quobyte-8754e0fc-bc1c-4b41-b8e5-b6d65729e63a" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ff2a8f71-f018-4bf1-b90c-3ef50e3e82dc tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Lock "cinder-quobyte-8754e0fc-bc1c-4b41-b8e5-b6d65729e63a" acquired by "delete_volume" :: waited 0.071s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:15 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_bdx7kyipdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c" returned: 0 in 3.047s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:15 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_bdx7kyipdevstack@QuobyteHD, size 112.00 MB, duration 3.05 sec, destination /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:26:15 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Converted 112.00 MB image at 36.68 MB/s Jul 07 17:26:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:15 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab189f90-7210-460e-b52e-bd6162a4070f]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ff2a8f71-f018-4bf1-b90c-3ef50e3e82dc tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8754e0fc-bc1c-4b41-b8e5-b6d65729e63a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:16 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c 1G Jul 07 17:26:16 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:16 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8754e0fc-bc1c-4b41-b8e5-b6d65729e63a Jul 07 17:26:16 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:18 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ff2a8f71-f018-4bf1-b90c-3ef50e3e82dc tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8754e0fc-bc1c-4b41-b8e5-b6d65729e63a" returned: 0 in 2.277s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ff2a8f71-f018-4bf1-b90c-3ef50e3e82dc tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8754e0fc-bc1c-4b41-b8e5-b6d65729e63a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:18 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8754e0fc-bc1c-4b41-b8e5-b6d65729e63a Jul 07 17:26:18 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:18 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c 1G" returned: 0 in 2.443s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:18 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb790ac-48dd-4802-9575-d06818dee50f]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:18 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c Jul 07 17:26:18 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:20 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ff2a8f71-f018-4bf1-b90c-3ef50e3e82dc tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8754e0fc-bc1c-4b41-b8e5-b6d65729e63a" returned: 0 in 1.900s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ff2a8f71-f018-4bf1-b90c-3ef50e3e82dc tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Lock "cinder-quobyte-8754e0fc-bc1c-4b41-b8e5-b6d65729e63a" released by "delete_volume" :: held 4.366s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:20 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-5bab1750-4aa6-4c2c-973e-284d23db2ff3 req-723bfc6b-29b8-4b39-9eeb-5446b23c91b5 tempest-AttachVolumeNegativeTest-1635603288 None] Terminate volume connection completed successfully. Jul 07 17:26:20 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-5bab1750-4aa6-4c2c-973e-284d23db2ff3 req-723bfc6b-29b8-4b39-9eeb-5446b23c91b5 tempest-AttachVolumeNegativeTest-1635603288 None] Deleting attachment f80d0e35-ee23-4905-bdfe-4c6f6178e7ac. {{(pid=87303) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:26:20 devstack cinder-volume[87303]: WARNING cinder.quota [None req-ff2a8f71-f018-4bf1-b90c-3ef50e3e82dc tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:26:20 devstack cinder-volume[87303]: WARNING cinder.quota [None req-ff2a8f71-f018-4bf1-b90c-3ef50e3e82dc tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:26:20 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-ff2a8f71-f018-4bf1-b90c-3ef50e3e82dc tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Created reservations ['980bccd9-3198-4d18-9607-dad9c9aed21b', '4aaf8b0b-5969-4416-925c-4596e9379aab', 'dc761905-1d46-4027-abcf-e61b8592040e', '4392b4ed-362a-4372-b84f-75cf1d73d497'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:26:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ff2a8f71-f018-4bf1-b90c-3ef50e3e82dc tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ff2a8f71-f018-4bf1-b90c-3ef50e3e82dc tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ff2a8f71-f018-4bf1-b90c-3ef50e3e82dc tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ff2a8f71-f018-4bf1-b90c-3ef50e3e82dc tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ff2a8f71-f018-4bf1-b90c-3ef50e3e82dc tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ff2a8f71-f018-4bf1-b90c-3ef50e3e82dc tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:20 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:26:20 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:20 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 /opt/stack/data/cinder/conversion/6e0b7e85-88cd-4828-9cb7-25166eafc3b0.temp_image.9514ecad-33aa-4540-9eea-92fd6f579cben2g8w9wx.img" returned: 0 in 6.335s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:20 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd842309-2506-4776-800d-05afd7306231]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:20 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c" returned: 0 in 2.019s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:20 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 Jul 07 17:26:20 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:20 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c Jul 07 17:26:20 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:21 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ff2a8f71-f018-4bf1-b90c-3ef50e3e82dc tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.885s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:21 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-ff2a8f71-f018-4bf1-b90c-3ef50e3e82dc tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:21 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-ff2a8f71-f018-4bf1-b90c-3ef50e3e82dc tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Deleted volume successfully. Jul 07 17:26:21 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c" returned: 1 in 1.049s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:26:21 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Downloaded image 919a0971-57b8-4ecd-833d-de05e9b603e2 ((None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}])) to volume 5200c5ee-e648-4843-9696-dea29b0ed66c successfully. {{(pid=87303) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:26:21 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Temporary image 919a0971-57b8-4ecd-833d-de05e9b603e2 for user 2f771809e3d04eb6bb8b90eb364a4d30 is deleted. {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:26:21 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Marking volume 5200c5ee-e648-4843-9696-dea29b0ed66c as bootable. {{(pid=87303) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:26:21 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0" returned: 0 in 1.211s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:21 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] Image conversion details: src /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0, size 1024.00 MB, duration 6.34 sec, destination /opt/stack/data/cinder/conversion/6e0b7e85-88cd-4828-9cb7-25166eafc3b0.temp_image.9514ecad-33aa-4540-9eea-92fd6f579cben2g8w9wx.img {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:26:21 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] Converted 1024.00 MB image at 161.55 MB/s Jul 07 17:26:21 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] 9514ecad-33aa-4540-9eea-92fd6f579cbe was raw, converting to qcow2 {{(pid=87303) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 07 17:26:21 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9d6492-4432-449b-bca9-556dc0d9c9d0]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6e0b7e85-88cd-4828-9cb7-25166eafc3b0.temp_image.9514ecad-33aa-4540-9eea-92fd6f579cben2g8w9wx.img {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:21 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Copying metadata from image 919a0971-57b8-4ecd-833d-de05e9b603e2 to 5200c5ee-e648-4843-9696-dea29b0ed66c. {{(pid=87303) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:26:21 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Creating volume glance metadata for volume 5200c5ee-e648-4843-9696-dea29b0ed66c backed by image 919a0971-57b8-4ecd-833d-de05e9b603e2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87303) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:26:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ff2a8f71-f018-4bf1-b90c-3ef50e3e82dc tempest-VolumeRetypeWithoutMigrationTest-1410830088 None] Lock "cinder-8754e0fc-bc1c-4b41-b8e5-b6d65729e63a-delete_volume" released by "delete_volume" :: held 6.082s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:21 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6e0b7e85-88cd-4828-9cb7-25166eafc3b0.temp_image.9514ecad-33aa-4540-9eea-92fd6f579cben2g8w9wx.img Jul 07 17:26:21 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f92b197-4ce4-4b75-a780-0b96d5eefd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5200c5ee-e648-4843-9696-dea29b0ed66c', 'volume_size': 1, 'image_id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '209334a192ee4ec7a4a563a01fc9db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/919a0971-57b8-4ecd-833d-de05e9b603e2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d31735-500b-43fc-bcd5-a33dc774ea2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:21 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Volume volume-5200c5ee-e648-4843-9696-dea29b0ed66c (5200c5ee-e648-4843-9696-dea29b0ed66c): created successfully Jul 07 17:26:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d31735-500b-43fc-bcd5-a33dc774ea2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Flow 'volume_create_manager' (d6ed189e-0e06-4bf4-aa73-10738b5c6924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:21 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-74915a00-552c-45de-a832-59a64cc1b4c4 tempest-TestShelveInstance-2013394509 None] Created volume successfully. Jul 07 17:26:22 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6e0b7e85-88cd-4828-9cb7-25166eafc3b0.temp_image.9514ecad-33aa-4540-9eea-92fd6f579cben2g8w9wx.img" returned: 0 in 0.923s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6e0b7e85-88cd-4828-9cb7-25166eafc3b0.temp_image.9514ecad-33aa-4540-9eea-92fd6f579cben2g8w9wx.img {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:22 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6e0b7e85-88cd-4828-9cb7-25166eafc3b0.temp_image.9514ecad-33aa-4540-9eea-92fd6f579cben2g8w9wx.img Jul 07 17:26:22 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:23 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6e0b7e85-88cd-4828-9cb7-25166eafc3b0.temp_image.9514ecad-33aa-4540-9eea-92fd6f579cben2g8w9wx.img" returned: 1 in 0.907s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6e0b7e85-88cd-4828-9cb7-25166eafc3b0.temp_image.9514ecad-33aa-4540-9eea-92fd6f579cben2g8w9wx.img' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:26:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6e0b7e85-88cd-4828-9cb7-25166eafc3b0.temp_image.9514ecad-33aa-4540-9eea-92fd6f579cben2g8w9wx.img /opt/stack/data/cinder/conversion/vol_upload_88jbtw8x {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:23 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6e0b7e85-88cd-4828-9cb7-25166eafc3b0.temp_image.9514ecad-33aa-4540-9eea-92fd6f579cben2g8w9wx.img /opt/stack/data/cinder/conversion/vol_upload_88jbtw8x Jul 07 17:26:23 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:24 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6e0b7e85-88cd-4828-9cb7-25166eafc3b0.temp_image.9514ecad-33aa-4540-9eea-92fd6f579cben2g8w9wx.img /opt/stack/data/cinder/conversion/vol_upload_88jbtw8x" returned: 0 in 1.068s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:24 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] Image conversion details: src /opt/stack/data/cinder/conversion/6e0b7e85-88cd-4828-9cb7-25166eafc3b0.temp_image.9514ecad-33aa-4540-9eea-92fd6f579cben2g8w9wx.img, size 1024.00 MB, duration 1.07 sec, destination /opt/stack/data/cinder/conversion/vol_upload_88jbtw8x {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:26:24 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] Converted 1024.00 MB image at 956.38 MB/s Jul 07 17:26:24 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[97399cd5-95c0-43a3-85fc-df9902a4bde2]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_88jbtw8x {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:24 devstack sudo[95652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_88jbtw8x Jul 07 17:26:24 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:25 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_88jbtw8x" returned: 0 in 1.147s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.332s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:27 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] Uploaded volume to glance image-id: 9514ecad-33aa-4540-9eea-92fd6f579cbe. {{(pid=87303) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 17:26:27 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-474b5dd5-3f73-42c2-9fe5-c1b96e9de694 tempest-VolumesActionsTest-1833333682 None] Copy volume to image completed successfully. Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4108e972-f545-437d-ba38-9deb43707cd4 tempest-VolumesActionsTest-1833333682 None] Acquiring lock "cinder-6e0b7e85-88cd-4828-9cb7-25166eafc3b0-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4108e972-f545-437d-ba38-9deb43707cd4 tempest-VolumesActionsTest-1833333682 None] Lock "cinder-6e0b7e85-88cd-4828-9cb7-25166eafc3b0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4108e972-f545-437d-ba38-9deb43707cd4 tempest-VolumesActionsTest-1833333682 None] Acquiring lock "cinder-quobyte-6e0b7e85-88cd-4828-9cb7-25166eafc3b0" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4108e972-f545-437d-ba38-9deb43707cd4 tempest-VolumesActionsTest-1833333682 None] Lock "cinder-quobyte-6e0b7e85-88cd-4828-9cb7-25166eafc3b0" acquired by "delete_volume" :: waited 0.030s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[259c4dde-752c-4f94-b76b-64b1a35615c1]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4108e972-f545-437d-ba38-9deb43707cd4 tempest-VolumesActionsTest-1833333682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:29 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 Jul 07 17:26:29 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Flow 'volume_create_manager' (3ebdde50-409b-42b3-9661-d8964d7a6ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2225e3f-ffbc-48d8-849a-342e8adedd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2225e3f-ffbc-48d8-849a-342e8adedd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-672395945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84db1cbc-2ddd-41e0-a82a-38817575658c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0caafc12ad104ee08440694ee8fd2daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:30Z,use_quota=True,user_id='8c8769d060124a78a346ce1b6c6c2215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b58d88ba-41d3-4d15-ac0f-c7e6f081bce0),volume_type_id=b58d88ba-41d3-4d15-ac0f-c7e6f081bce0)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530298e3-eab9-4092-ae8a-810ae8828bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530298e3-eab9-4092-ae8a-810ae8828bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60bc43a-1f3d-4029-8726-47bdf78f5eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60bc43a-1f3d-4029-8726-47bdf78f5eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84db1cbc-2ddd-41e0-a82a-38817575658c', 'volume_name': 'volume-84db1cbc-2ddd-41e0-a82a-38817575658c', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b350dc55-01e8-435d-92ad-57cba3dfa3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b350dc55-01e8-435d-92ad-57cba3dfa3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b507566a-8e13-417b-a3b3-562796c63f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:29 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Volume 84db1cbc-2ddd-41e0-a82a-38817575658c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84db1cbc-2ddd-41e0-a82a-38817575658c', 'volume_size': 1} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-672395945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84db1cbc-2ddd-41e0-a82a-38817575658c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0caafc12ad104ee08440694ee8fd2daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:30Z,use_quota=True,user_id='8c8769d060124a78a346ce1b6c6c2215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b58d88ba-41d3-4d15-ac0f-c7e6f081bce0),volume_type_id=b58d88ba-41d3-4d15-ac0f-c7e6f081bce0)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Creating volume 84db1cbc-2ddd-41e0-a82a-38817575658c {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:26:29 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:26:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84db1cbc-2ddd-41e0-a82a-38817575658c 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:29 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84db1cbc-2ddd-41e0-a82a-38817575658c 1073741824 Jul 07 17:26:29 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:30 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4108e972-f545-437d-ba38-9deb43707cd4 tempest-VolumesActionsTest-1833333682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0" returned: 0 in 1.143s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4108e972-f545-437d-ba38-9deb43707cd4 tempest-VolumesActionsTest-1833333682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:30 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0 Jul 07 17:26:30 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-895d91bd-77b4-4b7f-b44e-7f567bea7318 req-7e7e86a0-bf73-40fa-9da8-e5acab96cef3 tempest-TestShelveInstance-2013394509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:31 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84db1cbc-2ddd-41e0-a82a-38817575658c 1073741824" returned: 0 in 1.343s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84db1cbc-2ddd-41e0-a82a-38817575658c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:31 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84db1cbc-2ddd-41e0-a82a-38817575658c Jul 07 17:26:31 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:31 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4108e972-f545-437d-ba38-9deb43707cd4 tempest-VolumesActionsTest-1833333682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6e0b7e85-88cd-4828-9cb7-25166eafc3b0" returned: 0 in 1.109s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4108e972-f545-437d-ba38-9deb43707cd4 tempest-VolumesActionsTest-1833333682 None] Lock "cinder-quobyte-6e0b7e85-88cd-4828-9cb7-25166eafc3b0" released by "delete_volume" :: held 2.322s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:31 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-4108e972-f545-437d-ba38-9deb43707cd4 tempest-VolumesActionsTest-1833333682 None] Created reservations ['2048fb3e-fe6e-4d23-8994-fe0cde8d9642', 'd412fe22-fa09-48b4-b367-6c17a0476b93', '7c7832b9-5805-4aa4-b3f5-d740d09a7289', 'bdb07f48-e1c9-4188-808d-203f4fb0d23d'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:26:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4108e972-f545-437d-ba38-9deb43707cd4 tempest-VolumesActionsTest-1833333682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4108e972-f545-437d-ba38-9deb43707cd4 tempest-VolumesActionsTest-1833333682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4108e972-f545-437d-ba38-9deb43707cd4 tempest-VolumesActionsTest-1833333682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4108e972-f545-437d-ba38-9deb43707cd4 tempest-VolumesActionsTest-1833333682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4108e972-f545-437d-ba38-9deb43707cd4 tempest-VolumesActionsTest-1833333682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4108e972-f545-437d-ba38-9deb43707cd4 tempest-VolumesActionsTest-1833333682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:31 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:26:31 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:32 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84db1cbc-2ddd-41e0-a82a-38817575658c" returned: 0 in 0.923s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] <== create_volume: return (2325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:26:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.327s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-895d91bd-77b4-4b7f-b44e-7f567bea7318 req-7e7e86a0-bf73-40fa-9da8-e5acab96cef3 tempest-TestShelveInstance-2013394509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.991s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b507566a-8e13-417b-a3b3-562796c63f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84db1cbc-2ddd-41e0-a82a-38817575658c', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (757dafc2-23db-44d5-a319-6c04044587d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:32 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a01fe4c-8034-4406-b09f-140ac6979187]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-895d91bd-77b4-4b7f-b44e-7f567bea7318 req-7e7e86a0-bf73-40fa-9da8-e5acab96cef3 tempest-TestShelveInstance-2013394509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:32 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Volume volume-84db1cbc-2ddd-41e0-a82a-38817575658c (84db1cbc-2ddd-41e0-a82a-38817575658c): created successfully Jul 07 17:26:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (757dafc2-23db-44d5-a319-6c04044587d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Flow 'volume_create_manager' (3ebdde50-409b-42b3-9661-d8964d7a6ecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:32 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-bf430f4d-81ec-4c8b-813a-779c5f195316 tempest-VolumeTypesAccessTest-475125086 None] Created volume successfully. Jul 07 17:26:32 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c Jul 07 17:26:32 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:32 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4108e972-f545-437d-ba38-9deb43707cd4 tempest-VolumesActionsTest-1833333682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.994s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:32 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-4108e972-f545-437d-ba38-9deb43707cd4 tempest-VolumesActionsTest-1833333682 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:32 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-4108e972-f545-437d-ba38-9deb43707cd4 tempest-VolumesActionsTest-1833333682 None] Deleted volume successfully. Jul 07 17:26:32 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4108e972-f545-437d-ba38-9deb43707cd4 tempest-VolumesActionsTest-1833333682 None] Lock "cinder-6e0b7e85-88cd-4828-9cb7-25166eafc3b0-delete_volume" released by "delete_volume" :: held 3.730s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b5c3a5e4-e48d-4356-9ca6-882ded3c1e3f tempest-VolumeTypesAccessTest-475125086 None] Acquiring lock "cinder-84db1cbc-2ddd-41e0-a82a-38817575658c-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b5c3a5e4-e48d-4356-9ca6-882ded3c1e3f tempest-VolumeTypesAccessTest-475125086 None] Lock "cinder-84db1cbc-2ddd-41e0-a82a-38817575658c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b5c3a5e4-e48d-4356-9ca6-882ded3c1e3f tempest-VolumeTypesAccessTest-475125086 None] Acquiring lock "cinder-quobyte-84db1cbc-2ddd-41e0-a82a-38817575658c" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b5c3a5e4-e48d-4356-9ca6-882ded3c1e3f tempest-VolumeTypesAccessTest-475125086 None] Lock "cinder-quobyte-84db1cbc-2ddd-41e0-a82a-38817575658c" acquired by "delete_volume" :: waited 0.031s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:33 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[9667ab2a-9351-420e-99ec-78385882a045]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b5c3a5e4-e48d-4356-9ca6-882ded3c1e3f tempest-VolumeTypesAccessTest-475125086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84db1cbc-2ddd-41e0-a82a-38817575658c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:33 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84db1cbc-2ddd-41e0-a82a-38817575658c Jul 07 17:26:33 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:33 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-895d91bd-77b4-4b7f-b44e-7f567bea7318 req-7e7e86a0-bf73-40fa-9da8-e5acab96cef3 tempest-TestShelveInstance-2013394509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c" returned: 0 in 1.179s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-895d91bd-77b4-4b7f-b44e-7f567bea7318 req-7e7e86a0-bf73-40fa-9da8-e5acab96cef3 tempest-TestShelveInstance-2013394509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:33 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c Jul 07 17:26:33 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:34 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b5c3a5e4-e48d-4356-9ca6-882ded3c1e3f tempest-VolumeTypesAccessTest-475125086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84db1cbc-2ddd-41e0-a82a-38817575658c" returned: 0 in 1.152s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b5c3a5e4-e48d-4356-9ca6-882ded3c1e3f tempest-VolumeTypesAccessTest-475125086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84db1cbc-2ddd-41e0-a82a-38817575658c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:34 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84db1cbc-2ddd-41e0-a82a-38817575658c Jul 07 17:26:34 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:34 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-895d91bd-77b4-4b7f-b44e-7f567bea7318 req-7e7e86a0-bf73-40fa-9da8-e5acab96cef3 tempest-TestShelveInstance-2013394509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c" returned: 1 in 1.064s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-895d91bd-77b4-4b7f-b44e-7f567bea7318 req-7e7e86a0-bf73-40fa-9da8-e5acab96cef3 tempest-TestShelveInstance-2013394509 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:26:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-895d91bd-77b4-4b7f-b44e-7f567bea7318 req-7e7e86a0-bf73-40fa-9da8-e5acab96cef3 tempest-TestShelveInstance-2013394509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.337s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-895d91bd-77b4-4b7f-b44e-7f567bea7318 req-7e7e86a0-bf73-40fa-9da8-e5acab96cef3 tempest-TestShelveInstance-2013394509 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2', 'name': 'volume-5200c5ee-e648-4843-9696-dea29b0ed66c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba2cfafa-de3a-48e6-b955-786c6ec7e868', 'enforce_multipath': True} {{(pid=87303) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:26:34 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-895d91bd-77b4-4b7f-b44e-7f567bea7318 req-7e7e86a0-bf73-40fa-9da8-e5acab96cef3 tempest-TestShelveInstance-2013394509 None] attachment_update completed successfully. Jul 07 17:26:35 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b5c3a5e4-e48d-4356-9ca6-882ded3c1e3f tempest-VolumeTypesAccessTest-475125086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84db1cbc-2ddd-41e0-a82a-38817575658c" returned: 0 in 0.885s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b5c3a5e4-e48d-4356-9ca6-882ded3c1e3f tempest-VolumeTypesAccessTest-475125086 None] Lock "cinder-quobyte-84db1cbc-2ddd-41e0-a82a-38817575658c" released by "delete_volume" :: held 2.103s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:35 devstack cinder-volume[87303]: WARNING cinder.quota [None req-b5c3a5e4-e48d-4356-9ca6-882ded3c1e3f tempest-VolumeTypesAccessTest-475125086 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-201506833 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-201506833, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:26:35 devstack cinder-volume[87303]: WARNING cinder.quota [None req-b5c3a5e4-e48d-4356-9ca6-882ded3c1e3f tempest-VolumeTypesAccessTest-475125086 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-201506833 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-201506833, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:26:35 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-b5c3a5e4-e48d-4356-9ca6-882ded3c1e3f tempest-VolumeTypesAccessTest-475125086 None] Created reservations ['414bd78b-9b6f-4a99-af3f-c31cd2403283', '2ed29882-678c-41fb-bd6a-2f91fda361c6', '762187f0-39a0-4be0-af26-fffce86db0a5', '95ab010d-b2e8-429a-97a9-93f8cae03141'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:26:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b5c3a5e4-e48d-4356-9ca6-882ded3c1e3f tempest-VolumeTypesAccessTest-475125086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b5c3a5e4-e48d-4356-9ca6-882ded3c1e3f tempest-VolumeTypesAccessTest-475125086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:35 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b5c3a5e4-e48d-4356-9ca6-882ded3c1e3f tempest-VolumeTypesAccessTest-475125086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:35 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b5c3a5e4-e48d-4356-9ca6-882ded3c1e3f tempest-VolumeTypesAccessTest-475125086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b5c3a5e4-e48d-4356-9ca6-882ded3c1e3f tempest-VolumeTypesAccessTest-475125086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b5c3a5e4-e48d-4356-9ca6-882ded3c1e3f tempest-VolumeTypesAccessTest-475125086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:35 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:26:35 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:36 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b5c3a5e4-e48d-4356-9ca6-882ded3c1e3f tempest-VolumeTypesAccessTest-475125086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.797s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:36 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-b5c3a5e4-e48d-4356-9ca6-882ded3c1e3f tempest-VolumeTypesAccessTest-475125086 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:36 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b5c3a5e4-e48d-4356-9ca6-882ded3c1e3f tempest-VolumeTypesAccessTest-475125086 None] Deleted volume successfully. Jul 07 17:26:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b5c3a5e4-e48d-4356-9ca6-882ded3c1e3f tempest-VolumeTypesAccessTest-475125086 None] Lock "cinder-84db1cbc-2ddd-41e0-a82a-38817575658c-delete_volume" released by "delete_volume" :: held 3.228s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:42 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:26:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Flow 'volume_create_manager' (15bebe22-08f9-4586-a6ae-e819e7d900aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00291946-6380-4d82-bc08-e5bd43fb3daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00291946-6380-4d82-bc08-e5bd43fb3daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1258307362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a51a02f-d1b7-4030-9644-7aeb5a3122df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f79f84f7119347638c3a8a1948202c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:42Z,use_quota=True,user_id='2d5562b66e804430bf17acbfa5cb8c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71cb4059-d534-4b28-ad0f-524efb7b11ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71cb4059-d534-4b28-ad0f-524efb7b11ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac9a8c9e-3d8e-4e8f-96fc-99d4ef921904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac9a8c9e-3d8e-4e8f-96fc-99d4ef921904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a51a02f-d1b7-4030-9644-7aeb5a3122df', 'volume_name': 'volume-0a51a02f-d1b7-4030-9644-7aeb5a3122df', 'volume_size': 2}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020937a1-04b4-483a-8686-6ee2eb816e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020937a1-04b4-483a-8686-6ee2eb816e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a8d1a3-919b-45c5-bd50-2753a005a735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:42 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Volume 0a51a02f-d1b7-4030-9644-7aeb5a3122df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a51a02f-d1b7-4030-9644-7aeb5a3122df', 'volume_size': 2} Jul 07 17:26:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1258307362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a51a02f-d1b7-4030-9644-7aeb5a3122df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f79f84f7119347638c3a8a1948202c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:42Z,use_quota=True,user_id='2d5562b66e804430bf17acbfa5cb8c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:26:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Creating volume 0a51a02f-d1b7-4030-9644-7aeb5a3122df {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:26:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:26:42 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:26:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0a51a02f-d1b7-4030-9644-7aeb5a3122df 2147483648 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:42 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0a51a02f-d1b7-4030-9644-7aeb5a3122df 2147483648 Jul 07 17:26:42 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:44 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0a51a02f-d1b7-4030-9644-7aeb5a3122df 2147483648" returned: 0 in 1.989s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0a51a02f-d1b7-4030-9644-7aeb5a3122df {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:44 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0a51a02f-d1b7-4030-9644-7aeb5a3122df Jul 07 17:26:44 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:45 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0a51a02f-d1b7-4030-9644-7aeb5a3122df" returned: 0 in 1.335s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] <== create_volume: return (3430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:26:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.433s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a8d1a3-919b-45c5-bd50-2753a005a735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a51a02f-d1b7-4030-9644-7aeb5a3122df', 'volume_size': 2}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c559b0e-d17a-4e84-a3a5-133b424ee2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:45 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Volume volume-0a51a02f-d1b7-4030-9644-7aeb5a3122df (0a51a02f-d1b7-4030-9644-7aeb5a3122df): created successfully Jul 07 17:26:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c559b0e-d17a-4e84-a3a5-133b424ee2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Flow 'volume_create_manager' (15bebe22-08f9-4586-a6ae-e819e7d900aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:45 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-1a57d5b8-e34b-4544-b258-6c932c3ac86e tempest-VolumesCloneNegativeTest-970686970 None] Created volume successfully. Jul 07 17:26:46 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5d7fc4f7-f256-450a-b38d-a551a86ebe74 tempest-VolumesCloneNegativeTest-970686970 None] Acquiring lock "cinder-0a51a02f-d1b7-4030-9644-7aeb5a3122df-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:46 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5d7fc4f7-f256-450a-b38d-a551a86ebe74 tempest-VolumesCloneNegativeTest-970686970 None] Lock "cinder-0a51a02f-d1b7-4030-9644-7aeb5a3122df-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:47 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5d7fc4f7-f256-450a-b38d-a551a86ebe74 tempest-VolumesCloneNegativeTest-970686970 None] Acquiring lock "cinder-quobyte-0a51a02f-d1b7-4030-9644-7aeb5a3122df" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:26:47 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5d7fc4f7-f256-450a-b38d-a551a86ebe74 tempest-VolumesCloneNegativeTest-970686970 None] Lock "cinder-quobyte-0a51a02f-d1b7-4030-9644-7aeb5a3122df" acquired by "delete_volume" :: waited 0.030s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:26:47 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe880a4b-74fe-4e56-84dc-d36f1d913761]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:26:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5d7fc4f7-f256-450a-b38d-a551a86ebe74 tempest-VolumesCloneNegativeTest-970686970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0a51a02f-d1b7-4030-9644-7aeb5a3122df {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:47 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0a51a02f-d1b7-4030-9644-7aeb5a3122df Jul 07 17:26:47 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:48 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5d7fc4f7-f256-450a-b38d-a551a86ebe74 tempest-VolumesCloneNegativeTest-970686970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0a51a02f-d1b7-4030-9644-7aeb5a3122df" returned: 0 in 1.636s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5d7fc4f7-f256-450a-b38d-a551a86ebe74 tempest-VolumesCloneNegativeTest-970686970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0a51a02f-d1b7-4030-9644-7aeb5a3122df {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:48 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0a51a02f-d1b7-4030-9644-7aeb5a3122df Jul 07 17:26:48 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:50 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5d7fc4f7-f256-450a-b38d-a551a86ebe74 tempest-VolumesCloneNegativeTest-970686970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0a51a02f-d1b7-4030-9644-7aeb5a3122df" returned: 0 in 1.539s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:50 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5d7fc4f7-f256-450a-b38d-a551a86ebe74 tempest-VolumesCloneNegativeTest-970686970 None] Lock "cinder-quobyte-0a51a02f-d1b7-4030-9644-7aeb5a3122df" released by "delete_volume" :: held 3.285s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:50 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-5d7fc4f7-f256-450a-b38d-a551a86ebe74 tempest-VolumesCloneNegativeTest-970686970 None] Created reservations ['5dfbc1c3-5b0d-4594-a3a1-bdfa6cd935a6', '8a2b43e2-ffaf-443f-b763-f63c47733191', 'dd341573-c7ac-44c5-a5c5-d8a409143171', '78fc720f-9e7c-4046-9cf2-0d34da7076a5'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:26:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5d7fc4f7-f256-450a-b38d-a551a86ebe74 tempest-VolumesCloneNegativeTest-970686970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5d7fc4f7-f256-450a-b38d-a551a86ebe74 tempest-VolumesCloneNegativeTest-970686970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5d7fc4f7-f256-450a-b38d-a551a86ebe74 tempest-VolumesCloneNegativeTest-970686970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5d7fc4f7-f256-450a-b38d-a551a86ebe74 tempest-VolumesCloneNegativeTest-970686970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5d7fc4f7-f256-450a-b38d-a551a86ebe74 tempest-VolumesCloneNegativeTest-970686970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5d7fc4f7-f256-450a-b38d-a551a86ebe74 tempest-VolumesCloneNegativeTest-970686970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:50 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:26:50 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:51 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5d7fc4f7-f256-450a-b38d-a551a86ebe74 tempest-VolumesCloneNegativeTest-970686970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.230s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:51 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-5d7fc4f7-f256-450a-b38d-a551a86ebe74 tempest-VolumesCloneNegativeTest-970686970 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:51 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5d7fc4f7-f256-450a-b38d-a551a86ebe74 tempest-VolumesCloneNegativeTest-970686970 None] Deleted volume successfully. Jul 07 17:26:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5d7fc4f7-f256-450a-b38d-a551a86ebe74 tempest-VolumesCloneNegativeTest-970686970 None] Lock "cinder-0a51a02f-d1b7-4030-9644-7aeb5a3122df-delete_volume" released by "delete_volume" :: held 4.856s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:26:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:26:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:56 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:26:56 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:26:57 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Jul 07 17:26:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.039s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:26:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:26:57 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:26:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:26:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:26:59 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=48,cinder:UPDATE=56,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:26:59 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:26:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Flow 'volume_create_manager' (91b987fa-424a-44b0-8b63-20125f72fdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:26:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab8abf5-d345-4d35-b930-a682b3373147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab8abf5-d345-4d35-b930-a682b3373147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1903861596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e81edb5-fa3b-48c8-b073-fe6ddd63db9d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='298bb6e98d7548d1815b1b4413301b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:59Z,use_quota=True,user_id='85f79e79956e4beb9a47213a6709ea94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10fc40f4-515c-4aa4-bc38-8953b44afaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10fc40f4-515c-4aa4-bc38-8953b44afaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b704b22-e1da-4f8e-a9b4-019deb482af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b704b22-e1da-4f8e-a9b4-019deb482af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e81edb5-fa3b-48c8-b073-fe6ddd63db9d', 'volume_name': 'volume-4e81edb5-fa3b-48c8-b073-fe6ddd63db9d', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ec22403-d019-44cd-b88a-fbcdd887daa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ec22403-d019-44cd-b88a-fbcdd887daa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:26:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cee3fdc-bedb-41a8-8888-c236ec424074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:26:59 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Volume 4e81edb5-fa3b-48c8-b073-fe6ddd63db9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e81edb5-fa3b-48c8-b073-fe6ddd63db9d', 'volume_size': 1} Jul 07 17:26:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1903861596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e81edb5-fa3b-48c8-b073-fe6ddd63db9d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='298bb6e98d7548d1815b1b4413301b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:26:59Z,use_quota=True,user_id='85f79e79956e4beb9a47213a6709ea94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:26:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Creating volume 4e81edb5-fa3b-48c8-b073-fe6ddd63db9d {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:26:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:26:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:26:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:26:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:26:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:26:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:26:59 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:26:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4e81edb5-fa3b-48c8-b073-fe6ddd63db9d 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:26:59 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4e81edb5-fa3b-48c8-b073-fe6ddd63db9d 1073741824 Jul 07 17:26:59 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:00 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4e81edb5-fa3b-48c8-b073-fe6ddd63db9d 1073741824" returned: 0 in 1.567s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4e81edb5-fa3b-48c8-b073-fe6ddd63db9d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:01 devstack sudo[96433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4e81edb5-fa3b-48c8-b073-fe6ddd63db9d Jul 07 17:27:01 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:02 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4e81edb5-fa3b-48c8-b073-fe6ddd63db9d" returned: 0 in 1.184s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:02 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] <== create_volume: return (2868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:27:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.875s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cee3fdc-bedb-41a8-8888-c236ec424074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e81edb5-fa3b-48c8-b073-fe6ddd63db9d', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3278203e-d080-47fd-acb4-d1ccd288ed21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:02 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Volume volume-4e81edb5-fa3b-48c8-b073-fe6ddd63db9d (4e81edb5-fa3b-48c8-b073-fe6ddd63db9d): created successfully Jul 07 17:27:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3278203e-d080-47fd-acb4-d1ccd288ed21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Flow 'volume_create_manager' (91b987fa-424a-44b0-8b63-20125f72fdb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:02 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-6c035057-f89d-4b8e-8102-a5fab4960626 tempest-VolumesGetTest-1549281815 None] Created volume successfully. Jul 07 17:27:04 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:27:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Flow 'volume_create_manager' (e03162b9-40b3-49b1-90ee-08f9656c3382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2280fc8-4152-4de6-88bb-8eb4ea666364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2280fc8-4152-4de6-88bb-8eb4ea666364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-608560358',display_name='tempest-VolumesGetTest-Volume-634653954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a7a0b1-30f7-4eaf-88dc-861a91344929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='298bb6e98d7548d1815b1b4413301b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:04Z,use_quota=True,user_id='85f79e79956e4beb9a47213a6709ea94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b89e63-ad63-4ff9-8f1e-782c2be4285e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b89e63-ad63-4ff9-8f1e-782c2be4285e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc1eec6-d1f4-443b-8988-12e80669b6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc1eec6-d1f4-443b-8988-12e80669b6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a7a0b1-30f7-4eaf-88dc-861a91344929', 'volume_name': 'volume-54a7a0b1-30f7-4eaf-88dc-861a91344929', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9790ccfa-2c87-4fa3-a13b-f8c19867164e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9790ccfa-2c87-4fa3-a13b-f8c19867164e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5784667e-091e-4520-aa7e-a6d55a228f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:04 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Volume 54a7a0b1-30f7-4eaf-88dc-861a91344929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a7a0b1-30f7-4eaf-88dc-861a91344929', 'volume_size': 1} Jul 07 17:27:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-608560358',display_name='tempest-VolumesGetTest-Volume-634653954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a7a0b1-30f7-4eaf-88dc-861a91344929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='298bb6e98d7548d1815b1b4413301b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:04Z,use_quota=True,user_id='85f79e79956e4beb9a47213a6709ea94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:27:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Creating volume 54a7a0b1-30f7-4eaf-88dc-861a91344929 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:27:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:27:04 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:27:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-54a7a0b1-30f7-4eaf-88dc-861a91344929 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:04 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-54a7a0b1-30f7-4eaf-88dc-861a91344929 1073741824 Jul 07 17:27:04 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:05 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-54a7a0b1-30f7-4eaf-88dc-861a91344929 1073741824" returned: 0 in 1.063s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-54a7a0b1-30f7-4eaf-88dc-861a91344929 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:05 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-54a7a0b1-30f7-4eaf-88dc-861a91344929 Jul 07 17:27:05 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:06 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-54a7a0b1-30f7-4eaf-88dc-861a91344929" returned: 0 in 0.813s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:27:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5784667e-091e-4520-aa7e-a6d55a228f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a7a0b1-30f7-4eaf-88dc-861a91344929', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff632c38-c0bb-4bb9-9bd6-4f9a222af293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:06 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Volume volume-54a7a0b1-30f7-4eaf-88dc-861a91344929 (54a7a0b1-30f7-4eaf-88dc-861a91344929): created successfully Jul 07 17:27:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff632c38-c0bb-4bb9-9bd6-4f9a222af293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Flow 'volume_create_manager' (e03162b9-40b3-49b1-90ee-08f9656c3382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:06 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-838503c7-6b9c-4ebe-8393-386d811b8893 tempest-VolumesGetTest-1549281815 None] Created volume successfully. Jul 07 17:27:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cc47acd7-c501-4635-ac4d-12af67c671b7 tempest-VolumesGetTest-1549281815 None] Acquiring lock "cinder-54a7a0b1-30f7-4eaf-88dc-861a91344929-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cc47acd7-c501-4635-ac4d-12af67c671b7 tempest-VolumesGetTest-1549281815 None] Lock "cinder-54a7a0b1-30f7-4eaf-88dc-861a91344929-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cc47acd7-c501-4635-ac4d-12af67c671b7 tempest-VolumesGetTest-1549281815 None] Acquiring lock "cinder-quobyte-54a7a0b1-30f7-4eaf-88dc-861a91344929" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cc47acd7-c501-4635-ac4d-12af67c671b7 tempest-VolumesGetTest-1549281815 None] Lock "cinder-quobyte-54a7a0b1-30f7-4eaf-88dc-861a91344929" acquired by "delete_volume" :: waited 0.020s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:07 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[a652aa46-d3e5-4251-a1f3-ffba7aed79b7]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cc47acd7-c501-4635-ac4d-12af67c671b7 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-54a7a0b1-30f7-4eaf-88dc-861a91344929 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:08 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-54a7a0b1-30f7-4eaf-88dc-861a91344929 Jul 07 17:27:08 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:08 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cc47acd7-c501-4635-ac4d-12af67c671b7 tempest-VolumesGetTest-1549281815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-54a7a0b1-30f7-4eaf-88dc-861a91344929" returned: 0 in 0.932s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cc47acd7-c501-4635-ac4d-12af67c671b7 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-54a7a0b1-30f7-4eaf-88dc-861a91344929 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:08 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-54a7a0b1-30f7-4eaf-88dc-861a91344929 Jul 07 17:27:08 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:09 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cc47acd7-c501-4635-ac4d-12af67c671b7 tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-54a7a0b1-30f7-4eaf-88dc-861a91344929" returned: 0 in 1.097s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:09 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cc47acd7-c501-4635-ac4d-12af67c671b7 tempest-VolumesGetTest-1549281815 None] Lock "cinder-quobyte-54a7a0b1-30f7-4eaf-88dc-861a91344929" released by "delete_volume" :: held 2.085s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:09 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:UPDATE=56,cinder:SELECT=58,cinder:INSERT=16,cinder:DELETE=2 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:27:10 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-cc47acd7-c501-4635-ac4d-12af67c671b7 tempest-VolumesGetTest-1549281815 None] Created reservations ['723545c7-3dda-4514-9f69-3e67bccdbc26', 'efb1e934-8c68-4cf6-a1d1-1c46dabbd19c', '5f2ba5e9-51ed-4bc4-8105-5b9af2ea9145', 'a0c662a8-05f7-43f7-891f-248ce1c21ea6'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:27:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-cc47acd7-c501-4635-ac4d-12af67c671b7 tempest-VolumesGetTest-1549281815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-cc47acd7-c501-4635-ac4d-12af67c671b7 tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-cc47acd7-c501-4635-ac4d-12af67c671b7 tempest-VolumesGetTest-1549281815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-cc47acd7-c501-4635-ac4d-12af67c671b7 tempest-VolumesGetTest-1549281815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-cc47acd7-c501-4635-ac4d-12af67c671b7 tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cc47acd7-c501-4635-ac4d-12af67c671b7 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:10 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:27:10 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:11 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cc47acd7-c501-4635-ac4d-12af67c671b7 tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.855s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:11 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-cc47acd7-c501-4635-ac4d-12af67c671b7 tempest-VolumesGetTest-1549281815 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:27:11 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-cc47acd7-c501-4635-ac4d-12af67c671b7 tempest-VolumesGetTest-1549281815 None] Deleted volume successfully. Jul 07 17:27:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cc47acd7-c501-4635-ac4d-12af67c671b7 tempest-VolumesGetTest-1549281815 None] Lock "cinder-54a7a0b1-30f7-4eaf-88dc-861a91344929-delete_volume" released by "delete_volume" :: held 3.325s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f394dfef-d607-417b-bd21-e1ec3da94a6d tempest-VolumesGetTest-1549281815 None] Acquiring lock "cinder-4e81edb5-fa3b-48c8-b073-fe6ddd63db9d-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f394dfef-d607-417b-bd21-e1ec3da94a6d tempest-VolumesGetTest-1549281815 None] Lock "cinder-4e81edb5-fa3b-48c8-b073-fe6ddd63db9d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f394dfef-d607-417b-bd21-e1ec3da94a6d tempest-VolumesGetTest-1549281815 None] Acquiring lock "cinder-quobyte-4e81edb5-fa3b-48c8-b073-fe6ddd63db9d" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f394dfef-d607-417b-bd21-e1ec3da94a6d tempest-VolumesGetTest-1549281815 None] Lock "cinder-quobyte-4e81edb5-fa3b-48c8-b073-fe6ddd63db9d" acquired by "delete_volume" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:11 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d3dc62-f46c-4f81-a27d-c4e1b7505348]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f394dfef-d607-417b-bd21-e1ec3da94a6d tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4e81edb5-fa3b-48c8-b073-fe6ddd63db9d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:11 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4e81edb5-fa3b-48c8-b073-fe6ddd63db9d Jul 07 17:27:11 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:12 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f394dfef-d607-417b-bd21-e1ec3da94a6d tempest-VolumesGetTest-1549281815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4e81edb5-fa3b-48c8-b073-fe6ddd63db9d" returned: 0 in 0.924s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f394dfef-d607-417b-bd21-e1ec3da94a6d tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4e81edb5-fa3b-48c8-b073-fe6ddd63db9d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:12 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4e81edb5-fa3b-48c8-b073-fe6ddd63db9d Jul 07 17:27:12 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:13 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f394dfef-d607-417b-bd21-e1ec3da94a6d tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4e81edb5-fa3b-48c8-b073-fe6ddd63db9d" returned: 0 in 0.740s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:13 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f394dfef-d607-417b-bd21-e1ec3da94a6d tempest-VolumesGetTest-1549281815 None] Lock "cinder-quobyte-4e81edb5-fa3b-48c8-b073-fe6ddd63db9d" released by "delete_volume" :: held 1.718s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:13 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-f394dfef-d607-417b-bd21-e1ec3da94a6d tempest-VolumesGetTest-1549281815 None] Created reservations ['4517beeb-01d8-41dd-a012-5eb62dee7c0b', 'd9b49443-72fc-4e14-9219-3cd1244ca23a', 'c5058eee-4c6b-43d7-9cbb-6df729ff6047', '96d8f8f7-984f-41d2-bc62-cb227d52fb13'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:27:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f394dfef-d607-417b-bd21-e1ec3da94a6d tempest-VolumesGetTest-1549281815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f394dfef-d607-417b-bd21-e1ec3da94a6d tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f394dfef-d607-417b-bd21-e1ec3da94a6d tempest-VolumesGetTest-1549281815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f394dfef-d607-417b-bd21-e1ec3da94a6d tempest-VolumesGetTest-1549281815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f394dfef-d607-417b-bd21-e1ec3da94a6d tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f394dfef-d607-417b-bd21-e1ec3da94a6d tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:13 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:27:13 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:14 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f394dfef-d607-417b-bd21-e1ec3da94a6d tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.030s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-f394dfef-d607-417b-bd21-e1ec3da94a6d tempest-VolumesGetTest-1549281815 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:27:14 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-f394dfef-d607-417b-bd21-e1ec3da94a6d tempest-VolumesGetTest-1549281815 None] Deleted volume successfully. Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f394dfef-d607-417b-bd21-e1ec3da94a6d tempest-VolumesGetTest-1549281815 None] Lock "cinder-4e81edb5-fa3b-48c8-b073-fe6ddd63db9d-delete_volume" released by "delete_volume" :: held 3.009s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Flow 'volume_create_manager' (5e5e4419-68db-441a-8353-07cc4bf65842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1611c7fa-ff2e-486c-99eb-0f29d0e673ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1611c7fa-ff2e-486c-99eb-0f29d0e673ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-883995381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cf91273-1dea-49db-9307-d85ee3cc0a90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='298bb6e98d7548d1815b1b4413301b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:14Z,use_quota=True,user_id='85f79e79956e4beb9a47213a6709ea94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5bd6ef7-374e-4052-97e1-743988a7d3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5bd6ef7-374e-4052-97e1-743988a7d3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d956877f-aa84-47d4-af46-5a6d0618adbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d956877f-aa84-47d4-af46-5a6d0618adbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cf91273-1dea-49db-9307-d85ee3cc0a90', 'volume_name': 'volume-7cf91273-1dea-49db-9307-d85ee3cc0a90', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc089a60-5b00-4f0c-8104-0f74e0d48745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc089a60-5b00-4f0c-8104-0f74e0d48745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86762c1-6587-4b1f-9ff9-9a7616745c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:14 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Volume 7cf91273-1dea-49db-9307-d85ee3cc0a90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cf91273-1dea-49db-9307-d85ee3cc0a90', 'volume_size': 1} Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-883995381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cf91273-1dea-49db-9307-d85ee3cc0a90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='298bb6e98d7548d1815b1b4413301b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:14Z,use_quota=True,user_id='85f79e79956e4beb9a47213a6709ea94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Creating volume 7cf91273-1dea-49db-9307-d85ee3cc0a90 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:27:14 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:27:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:14 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 1073741824 Jul 07 17:27:14 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:15 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 1073741824" returned: 0 in 0.923s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:15 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 Jul 07 17:27:15 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:16 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90" returned: 0 in 0.843s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:16 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:27:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86762c1-6587-4b1f-9ff9-9a7616745c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cf91273-1dea-49db-9307-d85ee3cc0a90', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c6c4aa-cbae-4065-b24e-6394b5f11ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:16 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Volume volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 (7cf91273-1dea-49db-9307-d85ee3cc0a90): created successfully Jul 07 17:27:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c6c4aa-cbae-4065-b24e-6394b5f11ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Flow 'volume_create_manager' (5e5e4419-68db-441a-8353-07cc4bf65842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:16 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5a34d3a8-5736-49dc-8e0f-749f71787a5e tempest-VolumesGetTest-1549281815 None] Created volume successfully. Jul 07 17:27:18 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:27:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Flow 'volume_create_manager' (3ab7789b-f7b2-47ef-998a-306b3fe43337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbdeb7ff-3dd3-4bd9-b27a-23f69674b268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbdeb7ff-3dd3-4bd9-b27a-23f69674b268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-805749293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015b215c-0fa9-47dd-b2e5-c87937389eae,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='298bb6e98d7548d1815b1b4413301b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7cf91273-1dea-49db-9307-d85ee3cc0a90,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:18Z,use_quota=True,user_id='85f79e79956e4beb9a47213a6709ea94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c1a6b3-a4eb-4b7a-8184-201a51876b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c1a6b3-a4eb-4b7a-8184-201a51876b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ccbc06-c767-4762-bb14-2d9cf7a77508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ccbc06-c767-4762-bb14-2d9cf7a77508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '015b215c-0fa9-47dd-b2e5-c87937389eae', 'volume_name': 'volume-015b215c-0fa9-47dd-b2e5-c87937389eae', 'volume_size': 1, 'source_volid': '7cf91273-1dea-49db-9307-d85ee3cc0a90', 'source_volstatus': 'available'}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4d79fe-9c49-4f8e-b195-42c916c5b882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4d79fe-9c49-4f8e-b195-42c916c5b882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ddae8d0-cbcd-4017-a30a-57b8740d3f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:18 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Volume 015b215c-0fa9-47dd-b2e5-c87937389eae: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-015b215c-0fa9-47dd-b2e5-c87937389eae', 'volume_size': 1, 'source_volid': '7cf91273-1dea-49db-9307-d85ee3cc0a90', 'source_volstatus': 'available'} Jul 07 17:27:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:18 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Cloning volume 7cf91273-1dea-49db-9307-d85ee3cc0a90 to volume 015b215c-0fa9-47dd-b2e5-c87937389eae Jul 07 17:27:18 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Creating offline snapshot f56cd9ee-746f-4671-8017-be1c0a2f7937 of volume 7cf91273-1dea-49db-9307-d85ee3cc0a90 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:27:18 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeae28ba-b575-4f53-813c-95a5f5034768]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:18 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 Jul 07 17:27:18 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:19 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90" returned: 0 in 0.985s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.f56cd9ee-746f-4671-8017-be1c0a2f7937 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:19 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.f56cd9ee-746f-4671-8017-be1c0a2f7937 1G Jul 07 17:27:19 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:20 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:27:20 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Flow 'volume_create_manager' (039a2705-ac19-4ffd-9a5b-05f4451dd5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:20 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d375870a-a1e4-4bb8-8d63-4b19d242b682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:20 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d375870a-a1e4-4bb8-8d63-4b19d242b682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-37500152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce56bbd0-60bf-4361-bace-62452585d086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba109cf167ff489080e77c314e5e0343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:20Z,use_quota=True,user_id='4088f72dbd774c3d8c29e00552631f08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:20 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0296625d-e851-42bd-b56d-283bd4fc6159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:20 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0296625d-e851-42bd-b56d-283bd4fc6159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:20 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d441ffed-2887-4c91-af79-77076773f2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:20 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d441ffed-2887-4c91-af79-77076773f2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce56bbd0-60bf-4361-bace-62452585d086', 'volume_name': 'volume-ce56bbd0-60bf-4361-bace-62452585d086', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:20 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bcb1315-0382-4c54-b0fb-9c9f058594d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:20 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bcb1315-0382-4c54-b0fb-9c9f058594d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:20 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab020b5-da8e-4844-9e40-6742b128a1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:20 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Volume ce56bbd0-60bf-4361-bace-62452585d086: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce56bbd0-60bf-4361-bace-62452585d086', 'volume_size': 1} Jul 07 17:27:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:20 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-8bc14bbd-713a-4074-8d66-e365435b9479 req-ba11c8ae-d656-4141-8deb-256eebaf656c tempest-TestShelveInstance-2013394509 None] Terminate volume connection completed successfully. Jul 07 17:27:20 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-8bc14bbd-713a-4074-8d66-e365435b9479 req-ba11c8ae-d656-4141-8deb-256eebaf656c tempest-TestShelveInstance-2013394509 None] Deleting attachment ba2cfafa-de3a-48e6-b955-786c6ec7e868. {{(pid=87303) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:27:20 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.f56cd9ee-746f-4671-8017-be1c0a2f7937 1G" returned: 0 in 1.306s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.f56cd9ee-746f-4671-8017-be1c0a2f7937 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:20 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.f56cd9ee-746f-4671-8017-be1c0a2f7937 Jul 07 17:27:20 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:21 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.f56cd9ee-746f-4671-8017-be1c0a2f7937" returned: 0 in 0.914s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:21 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.f56cd9ee-746f-4671-8017-be1c0a2f7937 is being set with open permissions: ugo+rw Jul 07 17:27:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.f56cd9ee-746f-4671-8017-be1c0a2f7937 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:21 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.f56cd9ee-746f-4671-8017-be1c0a2f7937 Jul 07 17:27:21 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:22 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.f56cd9ee-746f-4671-8017-be1c0a2f7937" returned: 0 in 0.884s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:22 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.info Jul 07 17:27:22 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:23 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.info" returned: 0 in 0.775s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:23 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.info is being set with open permissions: ugo+rw Jul 07 17:27:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:23 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.info Jul 07 17:27:23 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:24 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.info" returned: 0 in 0.916s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Acquiring lock "cinder-quobyte-015b215c-0fa9-47dd-b2e5-c87937389eae" by "_copy_volume_from_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Lock "cinder-quobyte-015b215c-0fa9-47dd-b2e5-c87937389eae" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:24 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] snapshot: f56cd9ee-746f-4671-8017-be1c0a2f7937, volume: 015b215c-0fa9-47dd-b2e5-c87937389eae, {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:27:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:24 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:24 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:24 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93a7111-b38f-4d76-a128-eabdd8b69016]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.f56cd9ee-746f-4671-8017-be1c0a2f7937 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:24 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.f56cd9ee-746f-4671-8017-be1c0a2f7937 Jul 07 17:27:24 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:25 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.f56cd9ee-746f-4671-8017-be1c0a2f7937" returned: 0 in 0.843s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cf91273-1dea-49db-9307-d85ee3cc0a90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:27:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:27:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Creating direct copy from snapshot {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:27:25 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb86264-8eab-4e4a-8064-907a49e6cb7e]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:25 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 Jul 07 17:27:25 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:26 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90" returned: 0 in 0.976s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:26 devstack cinder-volume[87303]: DEBUG cinder.utils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Path /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-015b215c-0fa9-47dd-b2e5-c87937389eae not found in is_blk_device check {{(pid=87303) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:27:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-015b215c-0fa9-47dd-b2e5-c87937389eae {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:26 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-015b215c-0fa9-47dd-b2e5-c87937389eae Jul 07 17:27:26 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-db1a36a4-0897-4a32-a3f8-19557545a189 req-bc496848-79d0-4c02-aeb5-bee244bbbed8 tempest-TestShelveInstance-2013394509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:32 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-015b215c-0fa9-47dd-b2e5-c87937389eae" returned: 0 in 6.211s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:32 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06d238a-1722-464e-8168-c3656f5ad850]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:32 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 Jul 07 17:27:32 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:33 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90" returned: 0 in 1.123s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:33 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Image conversion details: src /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-015b215c-0fa9-47dd-b2e5-c87937389eae {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:27:33 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Converted 1024.00 MB image at 164.84 MB/s Jul 07 17:27:33 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-015b215c-0fa9-47dd-b2e5-c87937389eae is being set with open permissions: ugo+rw Jul 07 17:27:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-015b215c-0fa9-47dd-b2e5-c87937389eae {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:33 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-015b215c-0fa9-47dd-b2e5-c87937389eae Jul 07 17:27:33 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:34 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-015b215c-0fa9-47dd-b2e5-c87937389eae" returned: 0 in 0.774s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Lock "cinder-quobyte-015b215c-0fa9-47dd-b2e5-c87937389eae" released by "_copy_volume_from_snapshot" :: held 10.051s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Acquiring lock "cinder-quobyte-f56cd9ee-746f-4671-8017-be1c0a2f7937" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Lock "cinder-quobyte-f56cd9ee-746f-4671-8017-be1c0a2f7937" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Deleting offline snapshot f56cd9ee-746f-4671-8017-be1c0a2f7937 of volume 7cf91273-1dea-49db-9307-d85ee3cc0a90 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:27:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] snapshot_file for this snap is: volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.f56cd9ee-746f-4671-8017-be1c0a2f7937 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:27:34 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3af40c2-01e5-46bf-ad7f-e39db548ea4b]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.f56cd9ee-746f-4671-8017-be1c0a2f7937 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:34 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.f56cd9ee-746f-4671-8017-be1c0a2f7937 Jul 07 17:27:34 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:35 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.f56cd9ee-746f-4671-8017-be1c0a2f7937" returned: 0 in 0.881s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:35 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cf91273-1dea-49db-9307-d85ee3cc0a90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:27:35 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1863f5-f922-4a50-a01c-6b4c7790e631]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:35 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 Jul 07 17:27:35 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:36 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90" returned: 0 in 0.920s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.f56cd9ee-746f-4671-8017-be1c0a2f7937 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:36 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.f56cd9ee-746f-4671-8017-be1c0a2f7937 Jul 07 17:27:36 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:37 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.f56cd9ee-746f-4671-8017-be1c0a2f7937" returned: 0 in 0.846s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.f56cd9ee-746f-4671-8017-be1c0a2f7937 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:37 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.f56cd9ee-746f-4671-8017-be1c0a2f7937 Jul 07 17:27:37 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:37 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=15,cinder:UPDATE=20,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:27:38 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90.f56cd9ee-746f-4671-8017-be1c0a2f7937" returned: 0 in 0.747s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:38 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Lock "cinder-quobyte-f56cd9ee-746f-4671-8017-be1c0a2f7937" released by "_delete_snapshot" :: held 3.531s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.643s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.407s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-37500152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce56bbd0-60bf-4361-bace-62452585d086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba109cf167ff489080e77c314e5e0343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:20Z,use_quota=True,user_id='4088f72dbd774c3d8c29e00552631f08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:27:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Creating volume ce56bbd0-60bf-4361-bace-62452585d086 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:27:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:27:38 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:27:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ce56bbd0-60bf-4361-bace-62452585d086 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ddae8d0-cbcd-4017-a30a-57b8740d3f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-015b215c-0fa9-47dd-b2e5-c87937389eae', 'volume_size': 1, 'source_volid': '7cf91273-1dea-49db-9307-d85ee3cc0a90', 'source_volstatus': 'available'}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a60e571-5c96-4830-9315-3550e148a943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:38 devstack sudo[96632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ce56bbd0-60bf-4361-bace-62452585d086 1073741824 Jul 07 17:27:38 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:38 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Volume volume-015b215c-0fa9-47dd-b2e5-c87937389eae (015b215c-0fa9-47dd-b2e5-c87937389eae): created successfully Jul 07 17:27:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a60e571-5c96-4830-9315-3550e148a943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Flow 'volume_create_manager' (3ab7789b-f7b2-47ef-998a-306b3fe43337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:38 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b365d7b4-aa7d-4d2b-9a55-7638b8ee021a tempest-VolumesGetTest-1549281815 None] Created volume successfully. Jul 07 17:27:39 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ce56bbd0-60bf-4361-bace-62452585d086 1073741824" returned: 0 in 1.166s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ce56bbd0-60bf-4361-bace-62452585d086 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:39 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ce56bbd0-60bf-4361-bace-62452585d086 Jul 07 17:27:39 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:39 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:27:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Flow 'volume_create_manager' (2da9a451-99f6-44cd-a054-68a6c443748f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad1a400-de2d-4d06-8572-7a2338779bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad1a400-de2d-4d06-8572-7a2338779bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1398625992',display_name='tempest-VolumesGetTest-Volume-1792598488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beaf226e-c68f-4755-adfc-412099842b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='298bb6e98d7548d1815b1b4413301b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:39Z,use_quota=True,user_id='85f79e79956e4beb9a47213a6709ea94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f5aa00-c4ca-40f2-acf2-bb58a5cae496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f5aa00-c4ca-40f2-acf2-bb58a5cae496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2312d519-2ef4-4d5f-94f0-b027c7cf4d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2312d519-2ef4-4d5f-94f0-b027c7cf4d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beaf226e-c68f-4755-adfc-412099842b74', 'volume_name': 'volume-beaf226e-c68f-4755-adfc-412099842b74', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f71b619-1637-4aea-8723-396712b69e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f71b619-1637-4aea-8723-396712b69e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00695c55-a5e1-4478-9d93-dc69edfa7dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:39 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Volume beaf226e-c68f-4755-adfc-412099842b74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beaf226e-c68f-4755-adfc-412099842b74', 'volume_size': 1} Jul 07 17:27:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:40 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ce56bbd0-60bf-4361-bace-62452585d086" returned: 0 in 0.757s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:40 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:27:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.995s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-db1a36a4-0897-4a32-a3f8-19557545a189 req-bc496848-79d0-4c02-aeb5-bee244bbbed8 tempest-TestShelveInstance-2013394509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.597s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab020b5-da8e-4844-9e40-6742b128a1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce56bbd0-60bf-4361-bace-62452585d086', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a8c37c-24e0-476a-b441-df6d8bf5e60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:40 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Volume volume-ce56bbd0-60bf-4361-bace-62452585d086 (ce56bbd0-60bf-4361-bace-62452585d086): created successfully Jul 07 17:27:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a8c37c-24e0-476a-b441-df6d8bf5e60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Flow 'volume_create_manager' (039a2705-ac19-4ffd-9a5b-05f4451dd5e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:40 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[00279245-4c84-44a5-a9b6-2d6d0a251e90]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-db1a36a4-0897-4a32-a3f8-19557545a189 req-bc496848-79d0-4c02-aeb5-bee244bbbed8 tempest-TestShelveInstance-2013394509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:40 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-ee18248c-6d62-4465-8923-b22d58e95d6f tempest-AttachVolumeNegativeTest-1635603288 None] Created volume successfully. Jul 07 17:27:40 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c Jul 07 17:27:40 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:41 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-db1a36a4-0897-4a32-a3f8-19557545a189 req-bc496848-79d0-4c02-aeb5-bee244bbbed8 tempest-TestShelveInstance-2013394509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c" returned: 0 in 0.939s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-db1a36a4-0897-4a32-a3f8-19557545a189 req-bc496848-79d0-4c02-aeb5-bee244bbbed8 tempest-TestShelveInstance-2013394509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:41 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c Jul 07 17:27:41 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:41 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-db1a36a4-0897-4a32-a3f8-19557545a189 req-bc496848-79d0-4c02-aeb5-bee244bbbed8 tempest-TestShelveInstance-2013394509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c" returned: 1 in 0.836s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-db1a36a4-0897-4a32-a3f8-19557545a189 req-bc496848-79d0-4c02-aeb5-bee244bbbed8 tempest-TestShelveInstance-2013394509 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:27:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-db1a36a4-0897-4a32-a3f8-19557545a189 req-bc496848-79d0-4c02-aeb5-bee244bbbed8 tempest-TestShelveInstance-2013394509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.832s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.465s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:41 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1398625992',display_name='tempest-VolumesGetTest-Volume-1792598488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beaf226e-c68f-4755-adfc-412099842b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='298bb6e98d7548d1815b1b4413301b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:39Z,use_quota=True,user_id='85f79e79956e4beb9a47213a6709ea94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:27:41 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Creating volume beaf226e-c68f-4755-adfc-412099842b74 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:27:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:41 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:41 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:41 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:27:41 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:27:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-beaf226e-c68f-4755-adfc-412099842b74 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:41 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-beaf226e-c68f-4755-adfc-412099842b74 1073741824 Jul 07 17:27:41 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-db1a36a4-0897-4a32-a3f8-19557545a189 req-bc496848-79d0-4c02-aeb5-bee244bbbed8 tempest-TestShelveInstance-2013394509 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2', 'name': 'volume-5200c5ee-e648-4843-9696-dea29b0ed66c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1039ecda-7a38-4059-b77f-a6b98dbb18c1', 'enforce_multipath': True} {{(pid=87303) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:27:42 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-db1a36a4-0897-4a32-a3f8-19557545a189 req-bc496848-79d0-4c02-aeb5-bee244bbbed8 tempest-TestShelveInstance-2013394509 None] attachment_update completed successfully. Jul 07 17:27:43 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-beaf226e-c68f-4755-adfc-412099842b74 1073741824" returned: 0 in 1.217s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-beaf226e-c68f-4755-adfc-412099842b74 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:43 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-beaf226e-c68f-4755-adfc-412099842b74 Jul 07 17:27:43 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-8218c814-3ae7-4d0e-8759-a82649785eca req-df75d4cb-3a0d-4cd4-a984-0f4af9277244 tempest-AttachVolumeNegativeTest-1635603288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:44 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-beaf226e-c68f-4755-adfc-412099842b74" returned: 0 in 1.068s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] <== create_volume: return (2348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:27:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.352s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-8218c814-3ae7-4d0e-8759-a82649785eca req-df75d4cb-3a0d-4cd4-a984-0f4af9277244 tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.196s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00695c55-a5e1-4478-9d93-dc69edfa7dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beaf226e-c68f-4755-adfc-412099842b74', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c95042c-c6cb-4939-b335-f97c56f247d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:44 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a8055d-be53-4137-810c-ac090d740aa2]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-8218c814-3ae7-4d0e-8759-a82649785eca req-df75d4cb-3a0d-4cd4-a984-0f4af9277244 tempest-AttachVolumeNegativeTest-1635603288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ce56bbd0-60bf-4361-bace-62452585d086 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:44 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Volume volume-beaf226e-c68f-4755-adfc-412099842b74 (beaf226e-c68f-4755-adfc-412099842b74): created successfully Jul 07 17:27:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c95042c-c6cb-4939-b335-f97c56f247d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Flow 'volume_create_manager' (2da9a451-99f6-44cd-a054-68a6c443748f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:44 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-384344b6-3092-4449-b7b4-d3095b7500e5 tempest-VolumesGetTest-1549281815 None] Created volume successfully. Jul 07 17:27:44 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ce56bbd0-60bf-4361-bace-62452585d086 Jul 07 17:27:44 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:45 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-fffbfeca-4594-406f-b287-290bf4d3bac3 tempest-VolumesGetTest-1549281815 None] Acquiring lock "cinder-beaf226e-c68f-4755-adfc-412099842b74-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:45 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-fffbfeca-4594-406f-b287-290bf4d3bac3 tempest-VolumesGetTest-1549281815 None] Lock "cinder-beaf226e-c68f-4755-adfc-412099842b74-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:45 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-fffbfeca-4594-406f-b287-290bf4d3bac3 tempest-VolumesGetTest-1549281815 None] Acquiring lock "cinder-quobyte-beaf226e-c68f-4755-adfc-412099842b74" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:45 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-fffbfeca-4594-406f-b287-290bf4d3bac3 tempest-VolumesGetTest-1549281815 None] Lock "cinder-quobyte-beaf226e-c68f-4755-adfc-412099842b74" acquired by "delete_volume" :: waited 0.022s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:45 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[0054affe-ceeb-4309-9b00-87e36a8d6044]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fffbfeca-4594-406f-b287-290bf4d3bac3 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-beaf226e-c68f-4755-adfc-412099842b74 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:45 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-beaf226e-c68f-4755-adfc-412099842b74 Jul 07 17:27:45 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:45 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-8218c814-3ae7-4d0e-8759-a82649785eca req-df75d4cb-3a0d-4cd4-a984-0f4af9277244 tempest-AttachVolumeNegativeTest-1635603288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ce56bbd0-60bf-4361-bace-62452585d086" returned: 0 in 1.234s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-8218c814-3ae7-4d0e-8759-a82649785eca req-df75d4cb-3a0d-4cd4-a984-0f4af9277244 tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.290s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-8218c814-3ae7-4d0e-8759-a82649785eca req-df75d4cb-3a0d-4cd4-a984-0f4af9277244 tempest-AttachVolumeNegativeTest-1635603288 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2', 'name': 'volume-ce56bbd0-60bf-4361-bace-62452585d086', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46ec3cd0-d6c7-4998-aa89-dafcf0f8b025', 'enforce_multipath': True} {{(pid=87303) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:27:45 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-8218c814-3ae7-4d0e-8759-a82649785eca req-df75d4cb-3a0d-4cd4-a984-0f4af9277244 tempest-AttachVolumeNegativeTest-1635603288 None] attachment_update completed successfully. Jul 07 17:27:46 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fffbfeca-4594-406f-b287-290bf4d3bac3 tempest-VolumesGetTest-1549281815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-beaf226e-c68f-4755-adfc-412099842b74" returned: 0 in 1.063s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fffbfeca-4594-406f-b287-290bf4d3bac3 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-beaf226e-c68f-4755-adfc-412099842b74 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:46 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-beaf226e-c68f-4755-adfc-412099842b74 Jul 07 17:27:46 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:46 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fffbfeca-4594-406f-b287-290bf4d3bac3 tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-beaf226e-c68f-4755-adfc-412099842b74" returned: 0 in 0.709s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:46 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-fffbfeca-4594-406f-b287-290bf4d3bac3 tempest-VolumesGetTest-1549281815 None] Lock "cinder-quobyte-beaf226e-c68f-4755-adfc-412099842b74" released by "delete_volume" :: held 1.829s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:47 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-fffbfeca-4594-406f-b287-290bf4d3bac3 tempest-VolumesGetTest-1549281815 None] Created reservations ['e6942deb-4d05-486f-b03a-7c742a7e0919', 'a3694c73-cd60-4e5e-868b-c4d74432ffc3', 'b050e09b-28ef-4abf-8d88-a3fb746e6b15', '1135f79f-fdab-4ce0-9475-d24e86a86fdc'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:27:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-fffbfeca-4594-406f-b287-290bf4d3bac3 tempest-VolumesGetTest-1549281815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-fffbfeca-4594-406f-b287-290bf4d3bac3 tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-fffbfeca-4594-406f-b287-290bf4d3bac3 tempest-VolumesGetTest-1549281815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-fffbfeca-4594-406f-b287-290bf4d3bac3 tempest-VolumesGetTest-1549281815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-fffbfeca-4594-406f-b287-290bf4d3bac3 tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fffbfeca-4594-406f-b287-290bf4d3bac3 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:47 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:27:47 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:47 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1016380c-5c9c-4bd1-9c02-eabb0d31cd9b tempest-VolumesGetTest-1549281815 None] Acquiring lock "cinder-015b215c-0fa9-47dd-b2e5-c87937389eae-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:47 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1016380c-5c9c-4bd1-9c02-eabb0d31cd9b tempest-VolumesGetTest-1549281815 None] Lock "cinder-015b215c-0fa9-47dd-b2e5-c87937389eae-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:47 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1016380c-5c9c-4bd1-9c02-eabb0d31cd9b tempest-VolumesGetTest-1549281815 None] Acquiring lock "cinder-quobyte-015b215c-0fa9-47dd-b2e5-c87937389eae" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:47 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1016380c-5c9c-4bd1-9c02-eabb0d31cd9b tempest-VolumesGetTest-1549281815 None] Lock "cinder-quobyte-015b215c-0fa9-47dd-b2e5-c87937389eae" acquired by "delete_volume" :: waited 0.024s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:47 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ae1fd2-28f0-4dfb-bc47-93657848b85c]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1016380c-5c9c-4bd1-9c02-eabb0d31cd9b tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-015b215c-0fa9-47dd-b2e5-c87937389eae {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:47 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-015b215c-0fa9-47dd-b2e5-c87937389eae Jul 07 17:27:47 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:47 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fffbfeca-4594-406f-b287-290bf4d3bac3 tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.859s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:47 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-fffbfeca-4594-406f-b287-290bf4d3bac3 tempest-VolumesGetTest-1549281815 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:27:48 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-fffbfeca-4594-406f-b287-290bf4d3bac3 tempest-VolumesGetTest-1549281815 None] Deleted volume successfully. Jul 07 17:27:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-fffbfeca-4594-406f-b287-290bf4d3bac3 tempest-VolumesGetTest-1549281815 None] Lock "cinder-beaf226e-c68f-4755-adfc-412099842b74-delete_volume" released by "delete_volume" :: held 2.989s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:48 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1016380c-5c9c-4bd1-9c02-eabb0d31cd9b tempest-VolumesGetTest-1549281815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-015b215c-0fa9-47dd-b2e5-c87937389eae" returned: 0 in 1.095s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1016380c-5c9c-4bd1-9c02-eabb0d31cd9b tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-015b215c-0fa9-47dd-b2e5-c87937389eae {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:48 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-015b215c-0fa9-47dd-b2e5-c87937389eae Jul 07 17:27:48 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:49 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1016380c-5c9c-4bd1-9c02-eabb0d31cd9b tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-015b215c-0fa9-47dd-b2e5-c87937389eae" returned: 0 in 0.929s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:49 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1016380c-5c9c-4bd1-9c02-eabb0d31cd9b tempest-VolumesGetTest-1549281815 None] Lock "cinder-quobyte-015b215c-0fa9-47dd-b2e5-c87937389eae" released by "delete_volume" :: held 2.111s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:49 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-1016380c-5c9c-4bd1-9c02-eabb0d31cd9b tempest-VolumesGetTest-1549281815 None] Created reservations ['00661595-116d-43ab-9ae8-e339177f3a57', 'c9ad18fc-26d1-4f2d-9d80-b8b46deb4e1b', '55a0059a-e69c-4c8f-be74-ef514761a945', 'd3be8229-6430-40c6-8cd6-54756c589221'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:27:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1016380c-5c9c-4bd1-9c02-eabb0d31cd9b tempest-VolumesGetTest-1549281815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1016380c-5c9c-4bd1-9c02-eabb0d31cd9b tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1016380c-5c9c-4bd1-9c02-eabb0d31cd9b tempest-VolumesGetTest-1549281815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1016380c-5c9c-4bd1-9c02-eabb0d31cd9b tempest-VolumesGetTest-1549281815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1016380c-5c9c-4bd1-9c02-eabb0d31cd9b tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1016380c-5c9c-4bd1-9c02-eabb0d31cd9b tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:50 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:27:50 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:50 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1016380c-5c9c-4bd1-9c02-eabb0d31cd9b tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.866s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:50 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-1016380c-5c9c-4bd1-9c02-eabb0d31cd9b tempest-VolumesGetTest-1549281815 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:27:50 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-1016380c-5c9c-4bd1-9c02-eabb0d31cd9b tempest-VolumesGetTest-1549281815 None] Deleted volume successfully. Jul 07 17:27:50 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1016380c-5c9c-4bd1-9c02-eabb0d31cd9b tempest-VolumesGetTest-1549281815 None] Lock "cinder-015b215c-0fa9-47dd-b2e5-c87937389eae-delete_volume" released by "delete_volume" :: held 3.452s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:50 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1346c34d-0d6c-40ad-a5cc-291ab47dbb6c tempest-VolumesGetTest-1549281815 None] Acquiring lock "cinder-7cf91273-1dea-49db-9307-d85ee3cc0a90-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1346c34d-0d6c-40ad-a5cc-291ab47dbb6c tempest-VolumesGetTest-1549281815 None] Lock "cinder-7cf91273-1dea-49db-9307-d85ee3cc0a90-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1346c34d-0d6c-40ad-a5cc-291ab47dbb6c tempest-VolumesGetTest-1549281815 None] Acquiring lock "cinder-quobyte-7cf91273-1dea-49db-9307-d85ee3cc0a90" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:27:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1346c34d-0d6c-40ad-a5cc-291ab47dbb6c tempest-VolumesGetTest-1549281815 None] Lock "cinder-quobyte-7cf91273-1dea-49db-9307-d85ee3cc0a90" acquired by "delete_volume" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:27:51 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb60f60-fa9a-4625-a2cb-a8a19910005d]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1346c34d-0d6c-40ad-a5cc-291ab47dbb6c tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:51 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 Jul 07 17:27:51 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:52 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1346c34d-0d6c-40ad-a5cc-291ab47dbb6c tempest-VolumesGetTest-1549281815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90" returned: 0 in 1.303s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1346c34d-0d6c-40ad-a5cc-291ab47dbb6c tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:52 devstack sudo[97209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90 Jul 07 17:27:52 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:54 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1346c34d-0d6c-40ad-a5cc-291ab47dbb6c tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cf91273-1dea-49db-9307-d85ee3cc0a90" returned: 0 in 1.636s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:54 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1346c34d-0d6c-40ad-a5cc-291ab47dbb6c tempest-VolumesGetTest-1549281815 None] Lock "cinder-quobyte-7cf91273-1dea-49db-9307-d85ee3cc0a90" released by "delete_volume" :: held 3.070s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:54 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-1346c34d-0d6c-40ad-a5cc-291ab47dbb6c tempest-VolumesGetTest-1549281815 None] Created reservations ['2999164f-003d-4fe3-87f0-d0651fa7c13f', 'c95fa1fe-c41a-4ed3-ac81-36795cb3f7af', '0a5055ac-98cd-4e40-b763-13ebe0bb5e84', '58ae6d89-d3db-4214-a5d2-87dba1fba442'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:27:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1346c34d-0d6c-40ad-a5cc-291ab47dbb6c tempest-VolumesGetTest-1549281815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1346c34d-0d6c-40ad-a5cc-291ab47dbb6c tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:54 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1346c34d-0d6c-40ad-a5cc-291ab47dbb6c tempest-VolumesGetTest-1549281815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:54 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1346c34d-0d6c-40ad-a5cc-291ab47dbb6c tempest-VolumesGetTest-1549281815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1346c34d-0d6c-40ad-a5cc-291ab47dbb6c tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1346c34d-0d6c-40ad-a5cc-291ab47dbb6c tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:54 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:27:54 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:55 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-87a7ef3d-4493-4a1f-83d0-58aa46cfc4cb req-d18aeb22-7086-4670-8b2a-1119d9729b8e tempest-AttachVolumeNegativeTest-1635603288 None] Terminate volume connection completed successfully. Jul 07 17:27:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-87a7ef3d-4493-4a1f-83d0-58aa46cfc4cb req-d18aeb22-7086-4670-8b2a-1119d9729b8e tempest-AttachVolumeNegativeTest-1635603288 None] Deleting attachment 46ec3cd0-d6c7-4998-aa89-dafcf0f8b025. {{(pid=87303) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:27:56 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1346c34d-0d6c-40ad-a5cc-291ab47dbb6c tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.666s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:56 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-1346c34d-0d6c-40ad-a5cc-291ab47dbb6c tempest-VolumesGetTest-1549281815 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:27:56 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-1346c34d-0d6c-40ad-a5cc-291ab47dbb6c tempest-VolumesGetTest-1549281815 None] Deleted volume successfully. Jul 07 17:27:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1346c34d-0d6c-40ad-a5cc-291ab47dbb6c tempest-VolumesGetTest-1549281815 None] Lock "cinder-7cf91273-1dea-49db-9307-d85ee3cc0a90-delete_volume" released by "delete_volume" :: held 5.121s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:27:56 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:27:56 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Flow 'volume_create_manager' (c916b14d-9ae9-423a-87de-68b0e4c2abe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:56 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1de3ce-c327-4683-849f-485d391e598a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:56 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1de3ce-c327-4683-849f-485d391e598a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1448967343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e972712-bf13-4f12-a35b-0b972fd3f1e4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='298bb6e98d7548d1815b1b4413301b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:56Z,use_quota=True,user_id='85f79e79956e4beb9a47213a6709ea94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:56 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c3a9b0-3f54-4e62-82ce-4c4ae0b27fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:56 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c3a9b0-3f54-4e62-82ce-4c4ae0b27fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:56 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f53a52-120d-4891-8139-808025b36bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:56 devstack cinder-volume[87303]: DEBUG cinder.image.glance [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Creating Keystone auth plugin from conf {{(pid=87303) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:27:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:27:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:56 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:27:56 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Flow 'volume_create_manager' (3399fe52-1b50-4e6f-bf48-a56cbcda83c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (723e824f-a576-4737-93b9-f441cbb63c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (723e824f-a576-4737-93b9-f441cbb63c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2044655452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249e7127-0dd0-482f-9035-a127fe03d143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4738df9f3754a6c88c776a85e0ae158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:57Z,use_quota=True,user_id='92d2aa82d3b34104a4d65c0aad9d34ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262bb445-28e2-4b66-ba3f-357388a0fb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262bb445-28e2-4b66-ba3f-357388a0fb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb50deda-6a62-45c0-8fc5-e9130184c6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb50deda-6a62-45c0-8fc5-e9130184c6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '249e7127-0dd0-482f-9035-a127fe03d143', 'volume_name': 'volume-249e7127-0dd0-482f-9035-a127fe03d143', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233c5962-4f03-4953-bcac-99dbbf64b6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233c5962-4f03-4953-bcac-99dbbf64b6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (654583a8-bd00-48c6-bfde-327cb391d99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:57 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Volume 249e7127-0dd0-482f-9035-a127fe03d143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-249e7127-0dd0-482f-9035-a127fe03d143', 'volume_size': 1} Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2044655452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249e7127-0dd0-482f-9035-a127fe03d143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4738df9f3754a6c88c776a85e0ae158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:57Z,use_quota=True,user_id='92d2aa82d3b34104a4d65c0aad9d34ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Creating volume 249e7127-0dd0-482f-9035-a127fe03d143 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:27:57 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-249e7127-0dd0-482f-9035-a127fe03d143 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:57 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-249e7127-0dd0-482f-9035-a127fe03d143 1073741824 Jul 07 17:27:57 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f53a52-120d-4891-8139-808025b36bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2e972712-bf13-4f12-a35b-0b972fd3f1e4', 'volume_name': 'volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4', 'volume_size': 1, 'image_id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '209334a192ee4ec7a4a563a01fc9db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/919a0971-57b8-4ecd-833d-de05e9b603e2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f9de12c-593c-4e60-acd9-edfbba33f2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f9de12c-593c-4e60-acd9-edfbba33f2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (469ba946-0096-4343-88ae-62a799b48068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:27:57 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Volume 2e972712-bf13-4f12-a35b-0b972fd3f1e4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4', 'volume_size': 1, 'image_id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '209334a192ee4ec7a4a563a01fc9db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/919a0971-57b8-4ecd-833d-de05e9b603e2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 17:27:57 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Trying to clone 2e972712-bf13-4f12-a35b-0b972fd3f1e4 from image 919a0971-57b8-4ecd-833d-de05e9b603e2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}]). {{(pid=87303) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:27:58 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 2.184s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:58 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:27:58 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:27:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:27:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:27:58 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_cvbp08s4devstack@QuobyteHD, size 20.69 MB, duration 1.08 sec {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:27:58 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Image download 20.69 MB at 19.13 MB/s Jul 07 17:27:59 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac3a7c3-4565-485b-b3ab-ff40255165c9]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:27:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_cvbp08s4devstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:27:59 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_cvbp08s4devstack@QuobyteHD Jul 07 17:27:59 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:27:59 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Jul 07 17:27:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-249e7127-0dd0-482f-9035-a127fe03d143 1073741824" returned: 0 in 2.298s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:27:59 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=56,cinder:INSERT=15,cinder:UPDATE=61,cinder:DELETE=8 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:28:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-249e7127-0dd0-482f-9035-a127fe03d143 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:00 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-249e7127-0dd0-482f-9035-a127fe03d143 Jul 07 17:28:00 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:00 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_cvbp08s4devstack@QuobyteHD" returned: 0 in 1.646s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:00 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Temporary image 919a0971-57b8-4ecd-833d-de05e9b603e2 is fetched for user 85f79e79956e4beb9a47213a6709ea94. {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:28:00 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ef1f26-12e8-4b9f-acb7-c8f2d7afd62c]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_cvbp08s4devstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:01 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_cvbp08s4devstack@QuobyteHD Jul 07 17:28:01 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:02 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-249e7127-0dd0-482f-9035-a127fe03d143" returned: 0 in 2.094s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:02 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] <== create_volume: return (4484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:28:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.490s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (654583a8-bd00-48c6-bfde-327cb391d99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-249e7127-0dd0-482f-9035-a127fe03d143', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb673fd7-e7e7-430e-921a-18e4ba7d0c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:02 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Volume volume-249e7127-0dd0-482f-9035-a127fe03d143 (249e7127-0dd0-482f-9035-a127fe03d143): created successfully Jul 07 17:28:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb673fd7-e7e7-430e-921a-18e4ba7d0c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Flow 'volume_create_manager' (3399fe52-1b50-4e6f-bf48-a56cbcda83c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:02 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-ec0aac78-ca5c-4ba9-a531-6947b6628498 tempest-VolumesActionsTest-693965280 None] Created volume successfully. Jul 07 17:28:02 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_cvbp08s4devstack@QuobyteHD" returned: 0 in 1.970s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:02 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1448967343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e972712-bf13-4f12-a35b-0b972fd3f1e4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='298bb6e98d7548d1815b1b4413301b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:27:56Z,use_quota=True,user_id='85f79e79956e4beb9a47213a6709ea94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:28:02 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Creating volume 2e972712-bf13-4f12-a35b-0b972fd3f1e4 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:28:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:02 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:02 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:02 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:28:02 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:28:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:03 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4 1073741824 Jul 07 17:28:03 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7d67aaee-f416-465f-b7e5-c9a5df872d3f tempest-VolumesActionsTest-693965280 None] Acquiring lock "cinder-249e7127-0dd0-482f-9035-a127fe03d143" by "attach_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7d67aaee-f416-465f-b7e5-c9a5df872d3f tempest-VolumesActionsTest-693965280 None] Lock "cinder-249e7127-0dd0-482f-9035-a127fe03d143" acquired by "attach_volume" :: waited 0.053s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:03 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-7d67aaee-f416-465f-b7e5-c9a5df872d3f tempest-VolumesActionsTest-693965280 None] Attaching volume 249e7127-0dd0-482f-9035-a127fe03d143 to instance 101241d1-d751-461b-8f3a-f9bbbcdd730b at mountpoint /dev/vdb on host None. Jul 07 17:28:03 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-7d67aaee-f416-465f-b7e5-c9a5df872d3f tempest-VolumesActionsTest-693965280 None] Attach volume completed successfully. Jul 07 17:28:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7d67aaee-f416-465f-b7e5-c9a5df872d3f tempest-VolumesActionsTest-693965280 None] Lock "cinder-249e7127-0dd0-482f-9035-a127fe03d143" released by "attach_volume" :: held 0.182s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:04 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-c22c7113-4f70-4a72-97df-439270735dad tempest-VolumesActionsTest-1842254613 None] Terminate volume connection completed successfully. Jul 07 17:28:04 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4 1073741824" returned: 0 in 1.921s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:04 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4 Jul 07 17:28:04 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:05 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c22c7113-4f70-4a72-97df-439270735dad tempest-VolumesActionsTest-1842254613 None] Acquiring lock "cinder-249e7127-0dd0-482f-9035-a127fe03d143-detach_volume" by "detach_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:05 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c22c7113-4f70-4a72-97df-439270735dad tempest-VolumesActionsTest-1842254613 None] Lock "cinder-249e7127-0dd0-482f-9035-a127fe03d143-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:05 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-c22c7113-4f70-4a72-97df-439270735dad tempest-VolumesActionsTest-1842254613 None] Detaching volume 249e7127-0dd0-482f-9035-a127fe03d143 from instance 101241d1-d751-461b-8f3a-f9bbbcdd730b. Jul 07 17:28:05 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-c22c7113-4f70-4a72-97df-439270735dad tempest-VolumesActionsTest-1842254613 None] Detach volume completed successfully. Jul 07 17:28:05 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c22c7113-4f70-4a72-97df-439270735dad tempest-VolumesActionsTest-1842254613 None] Lock "cinder-249e7127-0dd0-482f-9035-a127fe03d143-detach_volume" released by "detach_volume" :: held 0.107s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:05 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4" returned: 0 in 1.017s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] <== create_volume: return (3014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:28:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.025s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:05 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Attempting download of 919a0971-57b8-4ecd-833d-de05e9b603e2 ((None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}])) to volume 2e972712-bf13-4f12-a35b-0b972fd3f1e4. {{(pid=87303) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:28:06 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[a410ad2a-90c0-4ac0-aef3-e49a9a86e2a8]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_tvea7mx0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cc48a2eb-3f0f-4477-bcfd-67fef5567f50 tempest-VolumesActionsTest-693965280 None] Acquiring lock "cinder-249e7127-0dd0-482f-9035-a127fe03d143-detach_volume" by "detach_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cc48a2eb-3f0f-4477-bcfd-67fef5567f50 tempest-VolumesActionsTest-693965280 None] Lock "cinder-249e7127-0dd0-482f-9035-a127fe03d143-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:06 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-cc48a2eb-3f0f-4477-bcfd-67fef5567f50 tempest-VolumesActionsTest-693965280 None] Volume detach called, but volume not attached. Jul 07 17:28:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cc48a2eb-3f0f-4477-bcfd-67fef5567f50 tempest-VolumesActionsTest-693965280 None] Lock "cinder-249e7127-0dd0-482f-9035-a127fe03d143-detach_volume" released by "detach_volume" :: held 0.035s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:06 devstack sudo[97342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_tvea7mx0 Jul 07 17:28:06 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-98ead76d-6494-4e16-9713-fbed04b386a2 tempest-VolumesActionsTest-693965280 None] Acquiring lock "cinder-249e7127-0dd0-482f-9035-a127fe03d143-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-98ead76d-6494-4e16-9713-fbed04b386a2 tempest-VolumesActionsTest-693965280 None] Lock "cinder-249e7127-0dd0-482f-9035-a127fe03d143-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-98ead76d-6494-4e16-9713-fbed04b386a2 tempest-VolumesActionsTest-693965280 None] Acquiring lock "cinder-quobyte-249e7127-0dd0-482f-9035-a127fe03d143" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-98ead76d-6494-4e16-9713-fbed04b386a2 tempest-VolumesActionsTest-693965280 None] Lock "cinder-quobyte-249e7127-0dd0-482f-9035-a127fe03d143" acquired by "delete_volume" :: waited 0.035s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:07 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e678d6d-cfe7-4e0b-8e96-7a4e76856215]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-98ead76d-6494-4e16-9713-fbed04b386a2 tempest-VolumesActionsTest-693965280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-249e7127-0dd0-482f-9035-a127fe03d143 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:07 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_tvea7mx0" returned: 0 in 1.119s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_tvea7mx0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:07 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-249e7127-0dd0-482f-9035-a127fe03d143 Jul 07 17:28:07 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:07 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_tvea7mx0 Jul 07 17:28:07 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:08 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-98ead76d-6494-4e16-9713-fbed04b386a2 tempest-VolumesActionsTest-693965280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-249e7127-0dd0-482f-9035-a127fe03d143" returned: 0 in 0.866s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-98ead76d-6494-4e16-9713-fbed04b386a2 tempest-VolumesActionsTest-693965280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-249e7127-0dd0-482f-9035-a127fe03d143 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:08 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-249e7127-0dd0-482f-9035-a127fe03d143 Jul 07 17:28:08 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:08 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_tvea7mx0" returned: 1 in 0.882s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_919a0971-57b8-4ecd-833d-de05e9b603e2_tvea7mx0' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:28:08 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[f471e855-233f-4852-9960-991b32b1892b]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_cvbp08s4devstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:08 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_cvbp08s4devstack@QuobyteHD Jul 07 17:28:08 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:08 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-98ead76d-6494-4e16-9713-fbed04b386a2 tempest-VolumesActionsTest-693965280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-249e7127-0dd0-482f-9035-a127fe03d143" returned: 0 in 0.870s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-98ead76d-6494-4e16-9713-fbed04b386a2 tempest-VolumesActionsTest-693965280 None] Lock "cinder-quobyte-249e7127-0dd0-482f-9035-a127fe03d143" released by "delete_volume" :: held 1.836s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:08 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-98ead76d-6494-4e16-9713-fbed04b386a2 tempest-VolumesActionsTest-693965280 None] Created reservations ['60616386-f9ba-4a07-bede-b801c1aa04a9', '78a6dee9-c5c2-4816-b6a2-decc9244c39d', 'dd733e59-543f-4681-8443-6c6832fa146f', 'df22c807-356d-4e04-8b1f-2babd9c8dea3'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:28:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-98ead76d-6494-4e16-9713-fbed04b386a2 tempest-VolumesActionsTest-693965280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-98ead76d-6494-4e16-9713-fbed04b386a2 tempest-VolumesActionsTest-693965280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:09 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-98ead76d-6494-4e16-9713-fbed04b386a2 tempest-VolumesActionsTest-693965280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:09 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-98ead76d-6494-4e16-9713-fbed04b386a2 tempest-VolumesActionsTest-693965280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-98ead76d-6494-4e16-9713-fbed04b386a2 tempest-VolumesActionsTest-693965280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-98ead76d-6494-4e16-9713-fbed04b386a2 tempest-VolumesActionsTest-693965280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:09 devstack sudo[97408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:28:09 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:09 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_cvbp08s4devstack@QuobyteHD" returned: 0 in 1.114s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:09 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] 919a0971-57b8-4ecd-833d-de05e9b603e2 was qcow2, converting to raw {{(pid=87303) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:28:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_cvbp08s4devstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:09 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_cvbp08s4devstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4 Jul 07 17:28:09 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:10 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-98ead76d-6494-4e16-9713-fbed04b386a2 tempest-VolumesActionsTest-693965280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.328s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:10 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-98ead76d-6494-4e16-9713-fbed04b386a2 tempest-VolumesActionsTest-693965280 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:28:10 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-98ead76d-6494-4e16-9713-fbed04b386a2 tempest-VolumesActionsTest-693965280 None] Deleted volume successfully. Jul 07 17:28:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-98ead76d-6494-4e16-9713-fbed04b386a2 tempest-VolumesActionsTest-693965280 None] Lock "cinder-249e7127-0dd0-482f-9035-a127fe03d143-delete_volume" released by "delete_volume" :: held 3.540s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:12 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_cvbp08s4devstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4" returned: 0 in 3.758s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:12 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_919a0971-57b8-4ecd-833d-de05e9b603e2_cvbp08s4devstack@QuobyteHD, size 112.00 MB, duration 3.76 sec, destination /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4 {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:28:12 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Converted 112.00 MB image at 29.80 MB/s Jul 07 17:28:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:13 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4 1G Jul 07 17:28:13 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:13 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4 1G" returned: 0 in 1.022s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:14 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[369e5ba7-1344-4830-9e83-47205602a505]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:14 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4 Jul 07 17:28:14 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:15 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4" returned: 0 in 1.073s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:15 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4 Jul 07 17:28:15 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:16 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4" returned: 1 in 0.946s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:28:16 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Downloaded image 919a0971-57b8-4ecd-833d-de05e9b603e2 ((None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}])) to volume 2e972712-bf13-4f12-a35b-0b972fd3f1e4 successfully. {{(pid=87303) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:28:16 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Temporary image 919a0971-57b8-4ecd-833d-de05e9b603e2 for user 85f79e79956e4beb9a47213a6709ea94 is deleted. {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:28:16 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Marking volume 2e972712-bf13-4f12-a35b-0b972fd3f1e4 as bootable. {{(pid=87303) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:28:16 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Copying metadata from image 919a0971-57b8-4ecd-833d-de05e9b603e2 to 2e972712-bf13-4f12-a35b-0b972fd3f1e4. {{(pid=87303) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:28:16 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Creating volume glance metadata for volume 2e972712-bf13-4f12-a35b-0b972fd3f1e4 backed by image 919a0971-57b8-4ecd-833d-de05e9b603e2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87303) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:28:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (469ba946-0096-4343-88ae-62a799b48068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4', 'volume_size': 1, 'image_id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/919a0971-57b8-4ecd-833d-de05e9b603e2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '209334a192ee4ec7a4a563a01fc9db32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '919a0971-57b8-4ecd-833d-de05e9b603e2', 'created_at': datetime.datetime(2026, 7, 7, 15, 11, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 11, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/919a0971-57b8-4ecd-833d-de05e9b603e2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1203a14-0607-47b7-87f8-95973a8b3ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:16 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Volume volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4 (2e972712-bf13-4f12-a35b-0b972fd3f1e4): created successfully Jul 07 17:28:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1203a14-0607-47b7-87f8-95973a8b3ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Flow 'volume_create_manager' (c916b14d-9ae9-423a-87de-68b0e4c2abe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:16 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-519f4fbe-46de-47b8-b0e7-5e7c7e07a048 tempest-VolumesGetTest-1549281815 None] Created volume successfully. Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Flow 'volume_create_manager' (363cc2be-da0f-430a-a82c-c15137d0aaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287109fa-3fbd-4666-baaa-10d7b7013f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287109fa-3fbd-4666-baaa-10d7b7013f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1261173074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=374fe73f-aef1-4bba-8092-bf9055b986ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4738df9f3754a6c88c776a85e0ae158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:17Z,use_quota=True,user_id='92d2aa82d3b34104a4d65c0aad9d34ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596609c6-7a6f-487f-a262-cd3adc40db6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596609c6-7a6f-487f-a262-cd3adc40db6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542614dc-92a0-4650-a62e-3ca5ba4bd7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542614dc-92a0-4650-a62e-3ca5ba4bd7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '374fe73f-aef1-4bba-8092-bf9055b986ea', 'volume_name': 'volume-374fe73f-aef1-4bba-8092-bf9055b986ea', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab3b1c5-c717-4758-b665-b16127b63309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab3b1c5-c717-4758-b665-b16127b63309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63546e35-710e-448b-aa72-41c067f5bb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:17 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Volume 374fe73f-aef1-4bba-8092-bf9055b986ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-374fe73f-aef1-4bba-8092-bf9055b986ea', 'volume_size': 1} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1261173074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=374fe73f-aef1-4bba-8092-bf9055b986ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4738df9f3754a6c88c776a85e0ae158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:17Z,use_quota=True,user_id='92d2aa82d3b34104a4d65c0aad9d34ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Creating volume 374fe73f-aef1-4bba-8092-bf9055b986ea {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:28:17 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374fe73f-aef1-4bba-8092-bf9055b986ea 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:17 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374fe73f-aef1-4bba-8092-bf9055b986ea 1073741824 Jul 07 17:28:17 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Flow 'volume_create_manager' (687217c8-86dc-4f03-92bb-6ed1da937888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d16d07-4bde-4802-8a5d-62cee6fb8187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d16d07-4bde-4802-8a5d-62cee6fb8187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2010681957',display_name='tempest-VolumesGetTest-Volume-525953097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0a4502-3a82-4d4d-b548-f2319dc2096c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='298bb6e98d7548d1815b1b4413301b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:18Z,use_quota=True,user_id='85f79e79956e4beb9a47213a6709ea94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e30e08-5559-4a64-87e1-3b3e3d319dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e30e08-5559-4a64-87e1-3b3e3d319dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c7b280-605a-4625-be14-220226b306fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c7b280-605a-4625-be14-220226b306fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd0a4502-3a82-4d4d-b548-f2319dc2096c', 'volume_name': 'volume-bd0a4502-3a82-4d4d-b548-f2319dc2096c', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101dc383-fe0c-4cd6-9649-0fc18df8bc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101dc383-fe0c-4cd6-9649-0fc18df8bc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (767b5f4b-f257-44ec-b86d-858e315cbd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:17 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Volume bd0a4502-3a82-4d4d-b548-f2319dc2096c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd0a4502-3a82-4d4d-b548-f2319dc2096c', 'volume_size': 1} Jul 07 17:28:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:18 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374fe73f-aef1-4bba-8092-bf9055b986ea 1073741824" returned: 0 in 0.898s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374fe73f-aef1-4bba-8092-bf9055b986ea {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:18 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374fe73f-aef1-4bba-8092-bf9055b986ea Jul 07 17:28:18 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:19 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374fe73f-aef1-4bba-8092-bf9055b986ea" returned: 0 in 0.676s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:28:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.391s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2010681957',display_name='tempest-VolumesGetTest-Volume-525953097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0a4502-3a82-4d4d-b548-f2319dc2096c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='298bb6e98d7548d1815b1b4413301b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:18Z,use_quota=True,user_id='85f79e79956e4beb9a47213a6709ea94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:28:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Creating volume bd0a4502-3a82-4d4d-b548-f2319dc2096c {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:28:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:28:19 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:28:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bd0a4502-3a82-4d4d-b548-f2319dc2096c 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63546e35-710e-448b-aa72-41c067f5bb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-374fe73f-aef1-4bba-8092-bf9055b986ea', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:19 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bd0a4502-3a82-4d4d-b548-f2319dc2096c 1073741824 Jul 07 17:28:19 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e0687e-0a8a-478b-a398-05b10985bcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:19 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Volume volume-374fe73f-aef1-4bba-8092-bf9055b986ea (374fe73f-aef1-4bba-8092-bf9055b986ea): created successfully Jul 07 17:28:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e0687e-0a8a-478b-a398-05b10985bcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Flow 'volume_create_manager' (363cc2be-da0f-430a-a82c-c15137d0aaa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:19 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-213c7881-c1f3-4dee-bf20-9d30403184aa tempest-VolumesActionsTest-693965280 None] Created volume successfully. Jul 07 17:28:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f9acd642-4a1c-4f4e-b786-9c519e7f389e tempest-VolumesActionsTest-1842254613 None] Acquiring lock "cinder-374fe73f-aef1-4bba-8092-bf9055b986ea-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f9acd642-4a1c-4f4e-b786-9c519e7f389e tempest-VolumesActionsTest-1842254613 None] Lock "cinder-374fe73f-aef1-4bba-8092-bf9055b986ea-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f9acd642-4a1c-4f4e-b786-9c519e7f389e tempest-VolumesActionsTest-1842254613 None] Acquiring lock "cinder-quobyte-374fe73f-aef1-4bba-8092-bf9055b986ea" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f9acd642-4a1c-4f4e-b786-9c519e7f389e tempest-VolumesActionsTest-1842254613 None] Lock "cinder-quobyte-374fe73f-aef1-4bba-8092-bf9055b986ea" acquired by "delete_volume" :: waited 0.017s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:19 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f238bec-071d-49be-96a4-bf0e9b20511c]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f9acd642-4a1c-4f4e-b786-9c519e7f389e tempest-VolumesActionsTest-1842254613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374fe73f-aef1-4bba-8092-bf9055b986ea {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:20 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374fe73f-aef1-4bba-8092-bf9055b986ea Jul 07 17:28:20 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:20 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bd0a4502-3a82-4d4d-b548-f2319dc2096c 1073741824" returned: 0 in 1.045s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bd0a4502-3a82-4d4d-b548-f2319dc2096c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:20 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bd0a4502-3a82-4d4d-b548-f2319dc2096c Jul 07 17:28:20 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:21 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f9acd642-4a1c-4f4e-b786-9c519e7f389e tempest-VolumesActionsTest-1842254613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374fe73f-aef1-4bba-8092-bf9055b986ea" returned: 0 in 1.221s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f9acd642-4a1c-4f4e-b786-9c519e7f389e tempest-VolumesActionsTest-1842254613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374fe73f-aef1-4bba-8092-bf9055b986ea {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:21 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374fe73f-aef1-4bba-8092-bf9055b986ea Jul 07 17:28:21 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:21 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bd0a4502-3a82-4d4d-b548-f2319dc2096c" returned: 0 in 0.930s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:28:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (767b5f4b-f257-44ec-b86d-858e315cbd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd0a4502-3a82-4d4d-b548-f2319dc2096c', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8254874c-77a5-4cae-9d70-af43c412028d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:21 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Volume volume-bd0a4502-3a82-4d4d-b548-f2319dc2096c (bd0a4502-3a82-4d4d-b548-f2319dc2096c): created successfully Jul 07 17:28:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8254874c-77a5-4cae-9d70-af43c412028d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Flow 'volume_create_manager' (687217c8-86dc-4f03-92bb-6ed1da937888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:21 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-0e402cea-f844-4e98-88bd-1c0288dd7074 tempest-VolumesGetTest-1549281815 None] Created volume successfully. Jul 07 17:28:22 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f9acd642-4a1c-4f4e-b786-9c519e7f389e tempest-VolumesActionsTest-1842254613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374fe73f-aef1-4bba-8092-bf9055b986ea" returned: 0 in 0.926s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:22 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f9acd642-4a1c-4f4e-b786-9c519e7f389e tempest-VolumesActionsTest-1842254613 None] Lock "cinder-quobyte-374fe73f-aef1-4bba-8092-bf9055b986ea" released by "delete_volume" :: held 2.226s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:22 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-f9acd642-4a1c-4f4e-b786-9c519e7f389e tempest-VolumesActionsTest-1842254613 None] Created reservations ['690e98e1-ef7b-452a-b3b6-99e7c7c19968', '5c975785-6a6a-43bf-9226-df7d22680df3', '6f9bd3c1-0d3d-4f58-82d8-42117b3c673f', 'a0360528-83ac-4038-bb61-d45583f9588d'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:28:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f9acd642-4a1c-4f4e-b786-9c519e7f389e tempest-VolumesActionsTest-1842254613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f9acd642-4a1c-4f4e-b786-9c519e7f389e tempest-VolumesActionsTest-1842254613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f9acd642-4a1c-4f4e-b786-9c519e7f389e tempest-VolumesActionsTest-1842254613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f9acd642-4a1c-4f4e-b786-9c519e7f389e tempest-VolumesActionsTest-1842254613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f9acd642-4a1c-4f4e-b786-9c519e7f389e tempest-VolumesActionsTest-1842254613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f9acd642-4a1c-4f4e-b786-9c519e7f389e tempest-VolumesActionsTest-1842254613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:22 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:28:22 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:22 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6b5a3fe1-8ed1-4390-a120-17c99d92876a tempest-VolumesGetTest-1549281815 None] Acquiring lock "cinder-bd0a4502-3a82-4d4d-b548-f2319dc2096c-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:22 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6b5a3fe1-8ed1-4390-a120-17c99d92876a tempest-VolumesGetTest-1549281815 None] Lock "cinder-bd0a4502-3a82-4d4d-b548-f2319dc2096c-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:22 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6b5a3fe1-8ed1-4390-a120-17c99d92876a tempest-VolumesGetTest-1549281815 None] Acquiring lock "cinder-quobyte-bd0a4502-3a82-4d4d-b548-f2319dc2096c" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:22 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6b5a3fe1-8ed1-4390-a120-17c99d92876a tempest-VolumesGetTest-1549281815 None] Lock "cinder-quobyte-bd0a4502-3a82-4d4d-b548-f2319dc2096c" acquired by "delete_volume" :: waited 0.035s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:22 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d675ee-aeca-41c3-b009-ad89df934818]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6b5a3fe1-8ed1-4390-a120-17c99d92876a tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bd0a4502-3a82-4d4d-b548-f2319dc2096c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:23 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bd0a4502-3a82-4d4d-b548-f2319dc2096c Jul 07 17:28:23 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:23 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f9acd642-4a1c-4f4e-b786-9c519e7f389e tempest-VolumesActionsTest-1842254613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.017s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:23 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-f9acd642-4a1c-4f4e-b786-9c519e7f389e tempest-VolumesActionsTest-1842254613 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:28:23 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-f9acd642-4a1c-4f4e-b786-9c519e7f389e tempest-VolumesActionsTest-1842254613 None] Deleted volume successfully. Jul 07 17:28:23 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f9acd642-4a1c-4f4e-b786-9c519e7f389e tempest-VolumesActionsTest-1842254613 None] Lock "cinder-374fe73f-aef1-4bba-8092-bf9055b986ea-delete_volume" released by "delete_volume" :: held 3.639s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:23 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:28:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Flow 'volume_create_manager' (1f122df3-7991-4556-a76b-0335ca83277f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59391fe6-11b8-4eae-872f-876d4114b031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59391fe6-11b8-4eae-872f-876d4114b031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-710038314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=168dad13-5ebd-443d-ac68-e2a77da89a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4738df9f3754a6c88c776a85e0ae158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:24Z,use_quota=True,user_id='92d2aa82d3b34104a4d65c0aad9d34ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60898a2a-3f14-44f2-a19a-5646bcff5987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60898a2a-3f14-44f2-a19a-5646bcff5987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d537676e-cc17-424d-a8b6-d7e38c253219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d537676e-cc17-424d-a8b6-d7e38c253219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '168dad13-5ebd-443d-ac68-e2a77da89a87', 'volume_name': 'volume-168dad13-5ebd-443d-ac68-e2a77da89a87', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0e9f25-ef5f-48f0-8971-068932cc9809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0e9f25-ef5f-48f0-8971-068932cc9809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e22036a-9a3d-46e4-b523-9fd67937e417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:24 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Volume 168dad13-5ebd-443d-ac68-e2a77da89a87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-168dad13-5ebd-443d-ac68-e2a77da89a87', 'volume_size': 1} Jul 07 17:28:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:24 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-710038314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=168dad13-5ebd-443d-ac68-e2a77da89a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4738df9f3754a6c88c776a85e0ae158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:24Z,use_quota=True,user_id='92d2aa82d3b34104a4d65c0aad9d34ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:28:24 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Creating volume 168dad13-5ebd-443d-ac68-e2a77da89a87 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:28:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:24 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:24 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:24 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:28:24 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:28:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-168dad13-5ebd-443d-ac68-e2a77da89a87 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:24 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-168dad13-5ebd-443d-ac68-e2a77da89a87 1073741824 Jul 07 17:28:24 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:24 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6b5a3fe1-8ed1-4390-a120-17c99d92876a tempest-VolumesGetTest-1549281815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bd0a4502-3a82-4d4d-b548-f2319dc2096c" returned: 0 in 1.285s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6b5a3fe1-8ed1-4390-a120-17c99d92876a tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bd0a4502-3a82-4d4d-b548-f2319dc2096c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:24 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bd0a4502-3a82-4d4d-b548-f2319dc2096c Jul 07 17:28:24 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:25 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6b5a3fe1-8ed1-4390-a120-17c99d92876a tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bd0a4502-3a82-4d4d-b548-f2319dc2096c" returned: 0 in 0.771s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6b5a3fe1-8ed1-4390-a120-17c99d92876a tempest-VolumesGetTest-1549281815 None] Lock "cinder-quobyte-bd0a4502-3a82-4d4d-b548-f2319dc2096c" released by "delete_volume" :: held 2.128s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:25 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-6b5a3fe1-8ed1-4390-a120-17c99d92876a tempest-VolumesGetTest-1549281815 None] Created reservations ['dd7f065a-e6e1-4660-96a9-db30f9109be5', '26c1e929-c8c7-49a5-a419-096aea3b5201', 'b4156749-f51d-4512-ac9e-03e14755eeaf', 'dafa4eac-4fce-406f-844f-0caaad884f1f'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:28:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6b5a3fe1-8ed1-4390-a120-17c99d92876a tempest-VolumesGetTest-1549281815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6b5a3fe1-8ed1-4390-a120-17c99d92876a tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6b5a3fe1-8ed1-4390-a120-17c99d92876a tempest-VolumesGetTest-1549281815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6b5a3fe1-8ed1-4390-a120-17c99d92876a tempest-VolumesGetTest-1549281815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6b5a3fe1-8ed1-4390-a120-17c99d92876a tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6b5a3fe1-8ed1-4390-a120-17c99d92876a tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:25 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:28:25 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:25 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-168dad13-5ebd-443d-ac68-e2a77da89a87 1073741824" returned: 0 in 1.092s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-168dad13-5ebd-443d-ac68-e2a77da89a87 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:25 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-168dad13-5ebd-443d-ac68-e2a77da89a87 Jul 07 17:28:25 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:25 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6b5a3fe1-8ed1-4390-a120-17c99d92876a tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.789s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:25 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-6b5a3fe1-8ed1-4390-a120-17c99d92876a tempest-VolumesGetTest-1549281815 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:28:25 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-6b5a3fe1-8ed1-4390-a120-17c99d92876a tempest-VolumesGetTest-1549281815 None] Deleted volume successfully. Jul 07 17:28:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6b5a3fe1-8ed1-4390-a120-17c99d92876a tempest-VolumesGetTest-1549281815 None] Lock "cinder-bd0a4502-3a82-4d4d-b548-f2319dc2096c-delete_volume" released by "delete_volume" :: held 3.297s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:26 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-168dad13-5ebd-443d-ac68-e2a77da89a87" returned: 0 in 0.795s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:26 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:28:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e22036a-9a3d-46e4-b523-9fd67937e417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-168dad13-5ebd-443d-ac68-e2a77da89a87', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bafdd4d-e27b-400b-b62f-e131f2de1dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:26 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Volume volume-168dad13-5ebd-443d-ac68-e2a77da89a87 (168dad13-5ebd-443d-ac68-e2a77da89a87): created successfully Jul 07 17:28:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bafdd4d-e27b-400b-b62f-e131f2de1dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Flow 'volume_create_manager' (1f122df3-7991-4556-a76b-0335ca83277f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:26 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-527596cb-8545-40f0-a924-2594d299b8ca tempest-VolumesActionsTest-693965280 None] Created volume successfully. Jul 07 17:28:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b6bbfad6-a2d6-4006-b9dd-a133bfbe170d tempest-VolumesGetTest-1549281815 None] Acquiring lock "cinder-2e972712-bf13-4f12-a35b-0b972fd3f1e4-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b6bbfad6-a2d6-4006-b9dd-a133bfbe170d tempest-VolumesGetTest-1549281815 None] Lock "cinder-2e972712-bf13-4f12-a35b-0b972fd3f1e4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b6bbfad6-a2d6-4006-b9dd-a133bfbe170d tempest-VolumesGetTest-1549281815 None] Acquiring lock "cinder-quobyte-2e972712-bf13-4f12-a35b-0b972fd3f1e4" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b6bbfad6-a2d6-4006-b9dd-a133bfbe170d tempest-VolumesGetTest-1549281815 None] Lock "cinder-quobyte-2e972712-bf13-4f12-a35b-0b972fd3f1e4" acquired by "delete_volume" :: waited 0.018s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:26 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f62c743-6d21-45b8-afb5-3d4aa23c98ba]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b6bbfad6-a2d6-4006-b9dd-a133bfbe170d tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:26 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4 Jul 07 17:28:26 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c1baa474-52d7-4bde-8a81-bd3a9c0ff514 tempest-VolumesActionsTest-1842254613 None] Acquiring lock "cinder-168dad13-5ebd-443d-ac68-e2a77da89a87-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c1baa474-52d7-4bde-8a81-bd3a9c0ff514 tempest-VolumesActionsTest-1842254613 None] Lock "cinder-168dad13-5ebd-443d-ac68-e2a77da89a87-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:27 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c1baa474-52d7-4bde-8a81-bd3a9c0ff514 tempest-VolumesActionsTest-1842254613 None] Acquiring lock "cinder-quobyte-168dad13-5ebd-443d-ac68-e2a77da89a87" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b6bbfad6-a2d6-4006-b9dd-a133bfbe170d tempest-VolumesGetTest-1549281815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4" returned: 0 in 1.225s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b6bbfad6-a2d6-4006-b9dd-a133bfbe170d tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c1baa474-52d7-4bde-8a81-bd3a9c0ff514 tempest-VolumesActionsTest-1842254613 None] Lock "cinder-quobyte-168dad13-5ebd-443d-ac68-e2a77da89a87" acquired by "delete_volume" :: waited 0.042s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:27 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28c7042-f0f0-4dfc-809b-1e9f4d236720]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c1baa474-52d7-4bde-8a81-bd3a9c0ff514 tempest-VolumesActionsTest-1842254613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-168dad13-5ebd-443d-ac68-e2a77da89a87 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:27 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-168dad13-5ebd-443d-ac68-e2a77da89a87 Jul 07 17:28:27 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:27 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4 Jul 07 17:28:27 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:28 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b6bbfad6-a2d6-4006-b9dd-a133bfbe170d tempest-VolumesGetTest-1549281815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4" returned: 1 in 1.107s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b6bbfad6-a2d6-4006-b9dd-a133bfbe170d tempest-VolumesGetTest-1549281815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:28:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b6bbfad6-a2d6-4006-b9dd-a133bfbe170d tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:28 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4 Jul 07 17:28:28 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:28 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c1baa474-52d7-4bde-8a81-bd3a9c0ff514 tempest-VolumesActionsTest-1842254613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-168dad13-5ebd-443d-ac68-e2a77da89a87" returned: 0 in 1.071s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c1baa474-52d7-4bde-8a81-bd3a9c0ff514 tempest-VolumesActionsTest-1842254613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-168dad13-5ebd-443d-ac68-e2a77da89a87 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:28 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-168dad13-5ebd-443d-ac68-e2a77da89a87 Jul 07 17:28:28 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:29 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c1baa474-52d7-4bde-8a81-bd3a9c0ff514 tempest-VolumesActionsTest-1842254613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-168dad13-5ebd-443d-ac68-e2a77da89a87" returned: 0 in 0.693s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c1baa474-52d7-4bde-8a81-bd3a9c0ff514 tempest-VolumesActionsTest-1842254613 None] Lock "cinder-quobyte-168dad13-5ebd-443d-ac68-e2a77da89a87" released by "delete_volume" :: held 1.867s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:29 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b6bbfad6-a2d6-4006-b9dd-a133bfbe170d tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2e972712-bf13-4f12-a35b-0b972fd3f1e4" returned: 0 in 0.821s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b6bbfad6-a2d6-4006-b9dd-a133bfbe170d tempest-VolumesGetTest-1549281815 None] Lock "cinder-quobyte-2e972712-bf13-4f12-a35b-0b972fd3f1e4" released by "delete_volume" :: held 3.223s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:29 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-c1baa474-52d7-4bde-8a81-bd3a9c0ff514 tempest-VolumesActionsTest-1842254613 None] Created reservations ['6e4c4e3d-072a-42ab-a2f7-72f9e75893be', '08208299-c10c-4b97-9b6c-5b897e003e82', '682f3ffb-28ee-471a-8f23-5d3d7db6615f', 'd2757a42-fb4b-409d-b5a1-1690f67601a0'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:28:29 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-b6bbfad6-a2d6-4006-b9dd-a133bfbe170d tempest-VolumesGetTest-1549281815 None] Created reservations ['a42f631d-d46d-431b-874a-413e9ce9b00e', '9dc89b8c-a92a-428a-b253-1b536a43a858', '59acb21b-4415-48a5-b3bb-7da0e3f50202', 'ffecbf90-1046-4ba7-93bb-4bb8f8aaaec4'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:28:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c1baa474-52d7-4bde-8a81-bd3a9c0ff514 tempest-VolumesActionsTest-1842254613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c1baa474-52d7-4bde-8a81-bd3a9c0ff514 tempest-VolumesActionsTest-1842254613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c1baa474-52d7-4bde-8a81-bd3a9c0ff514 tempest-VolumesActionsTest-1842254613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c1baa474-52d7-4bde-8a81-bd3a9c0ff514 tempest-VolumesActionsTest-1842254613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c1baa474-52d7-4bde-8a81-bd3a9c0ff514 tempest-VolumesActionsTest-1842254613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c1baa474-52d7-4bde-8a81-bd3a9c0ff514 tempest-VolumesActionsTest-1842254613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:29 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:28:29 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b6bbfad6-a2d6-4006-b9dd-a133bfbe170d tempest-VolumesGetTest-1549281815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b6bbfad6-a2d6-4006-b9dd-a133bfbe170d tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b6bbfad6-a2d6-4006-b9dd-a133bfbe170d tempest-VolumesGetTest-1549281815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b6bbfad6-a2d6-4006-b9dd-a133bfbe170d tempest-VolumesGetTest-1549281815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b6bbfad6-a2d6-4006-b9dd-a133bfbe170d tempest-VolumesGetTest-1549281815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b6bbfad6-a2d6-4006-b9dd-a133bfbe170d tempest-VolumesGetTest-1549281815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:29 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:28:29 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:30 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:28:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Flow 'volume_create_manager' (2ef85c75-ec65-44d8-a036-e7c4b13fcb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (836c7b1d-d411-451a-ae18-7bb5d2bd7e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:30 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (836c7b1d-d411-451a-ae18-7bb5d2bd7e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1464763025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80ba9fc3-63e0-4419-a406-ef1521815444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4738df9f3754a6c88c776a85e0ae158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:31Z,use_quota=True,user_id='92d2aa82d3b34104a4d65c0aad9d34ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d969d8bd-9a1f-4004-afb0-fd45ef2b21c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d969d8bd-9a1f-4004-afb0-fd45ef2b21c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecba71ec-3a8a-45b1-9b08-722fbb4dee01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecba71ec-3a8a-45b1-9b08-722fbb4dee01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80ba9fc3-63e0-4419-a406-ef1521815444', 'volume_name': 'volume-80ba9fc3-63e0-4419-a406-ef1521815444', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8a4d9c-cc48-4b19-900a-6b0d125a616f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8a4d9c-cc48-4b19-900a-6b0d125a616f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c1de44-4c43-4d82-a8d2-3487ffaa1eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:31 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Volume 80ba9fc3-63e0-4419-a406-ef1521815444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80ba9fc3-63e0-4419-a406-ef1521815444', 'volume_size': 1} Jul 07 17:28:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1464763025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80ba9fc3-63e0-4419-a406-ef1521815444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4738df9f3754a6c88c776a85e0ae158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:31Z,use_quota=True,user_id='92d2aa82d3b34104a4d65c0aad9d34ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:28:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Creating volume 80ba9fc3-63e0-4419-a406-ef1521815444 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:28:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:28:31 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:28:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-80ba9fc3-63e0-4419-a406-ef1521815444 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c1baa474-52d7-4bde-8a81-bd3a9c0ff514 tempest-VolumesActionsTest-1842254613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.463s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:31 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-c1baa474-52d7-4bde-8a81-bd3a9c0ff514 tempest-VolumesActionsTest-1842254613 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:28:31 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-c1baa474-52d7-4bde-8a81-bd3a9c0ff514 tempest-VolumesActionsTest-1842254613 None] Deleted volume successfully. Jul 07 17:28:31 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:31 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-80ba9fc3-63e0-4419-a406-ef1521815444 1073741824 Jul 07 17:28:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b6bbfad6-a2d6-4006-b9dd-a133bfbe170d tempest-VolumesGetTest-1549281815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.368s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:31 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-b6bbfad6-a2d6-4006-b9dd-a133bfbe170d tempest-VolumesGetTest-1549281815 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:28:31 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:31 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b6bbfad6-a2d6-4006-b9dd-a133bfbe170d tempest-VolumesGetTest-1549281815 None] Deleted volume successfully. Jul 07 17:28:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c1baa474-52d7-4bde-8a81-bd3a9c0ff514 tempest-VolumesActionsTest-1842254613 None] Lock "cinder-168dad13-5ebd-443d-ac68-e2a77da89a87-delete_volume" released by "delete_volume" :: held 3.750s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b6bbfad6-a2d6-4006-b9dd-a133bfbe170d tempest-VolumesGetTest-1549281815 None] Lock "cinder-2e972712-bf13-4f12-a35b-0b972fd3f1e4-delete_volume" released by "delete_volume" :: held 5.039s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:32 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-80ba9fc3-63e0-4419-a406-ef1521815444 1073741824" returned: 0 in 1.352s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-80ba9fc3-63e0-4419-a406-ef1521815444 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:32 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-80ba9fc3-63e0-4419-a406-ef1521815444 Jul 07 17:28:32 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:33 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-80ba9fc3-63e0-4419-a406-ef1521815444" returned: 0 in 0.979s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:33 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] <== create_volume: return (2416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:28:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.423s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c1de44-4c43-4d82-a8d2-3487ffaa1eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80ba9fc3-63e0-4419-a406-ef1521815444', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13950162-2447-4ccb-8a84-2cb03b54f54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:33 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Volume volume-80ba9fc3-63e0-4419-a406-ef1521815444 (80ba9fc3-63e0-4419-a406-ef1521815444): created successfully Jul 07 17:28:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13950162-2447-4ccb-8a84-2cb03b54f54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Flow 'volume_create_manager' (2ef85c75-ec65-44d8-a036-e7c4b13fcb51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:33 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-049e10c2-6303-4b44-860a-f24324be2f3f tempest-VolumesActionsTest-693965280 None] Created volume successfully. Jul 07 17:28:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-740bbc95-be7c-4ae7-b5d1-670c0c15bc71 tempest-VolumesActionsTest-1842254613 None] Acquiring lock "cinder-80ba9fc3-63e0-4419-a406-ef1521815444-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-740bbc95-be7c-4ae7-b5d1-670c0c15bc71 tempest-VolumesActionsTest-1842254613 None] Lock "cinder-80ba9fc3-63e0-4419-a406-ef1521815444-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-740bbc95-be7c-4ae7-b5d1-670c0c15bc71 tempest-VolumesActionsTest-1842254613 None] Acquiring lock "cinder-quobyte-80ba9fc3-63e0-4419-a406-ef1521815444" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-740bbc95-be7c-4ae7-b5d1-670c0c15bc71 tempest-VolumesActionsTest-1842254613 None] Lock "cinder-quobyte-80ba9fc3-63e0-4419-a406-ef1521815444" acquired by "delete_volume" :: waited 0.023s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:34 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5ec424-d738-46ca-a23d-36fef232e894]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-740bbc95-be7c-4ae7-b5d1-670c0c15bc71 tempest-VolumesActionsTest-1842254613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-80ba9fc3-63e0-4419-a406-ef1521815444 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:34 devstack sudo[97657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-80ba9fc3-63e0-4419-a406-ef1521815444 Jul 07 17:28:34 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:36 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-740bbc95-be7c-4ae7-b5d1-670c0c15bc71 tempest-VolumesActionsTest-1842254613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-80ba9fc3-63e0-4419-a406-ef1521815444" returned: 0 in 1.669s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-740bbc95-be7c-4ae7-b5d1-670c0c15bc71 tempest-VolumesActionsTest-1842254613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-80ba9fc3-63e0-4419-a406-ef1521815444 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:36 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-80ba9fc3-63e0-4419-a406-ef1521815444 Jul 07 17:28:36 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Flow 'volume_create_manager' (aed5e36a-a9ce-4905-8933-488cba67e44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (300be4e6-7701-4f15-a478-f49f121e8ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (300be4e6-7701-4f15-a478-f49f121e8ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-46061057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3938b18b-0ea5-4678-b8aa-7dbbdd039cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e660f9cf174122bad6ca06aa1b889b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:36Z,use_quota=True,user_id='e00952f6151e45278240b496156ee6af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd3d189-6e4d-4cb9-ba8a-2622146a53d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd3d189-6e4d-4cb9-ba8a-2622146a53d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099a376e-5d75-4298-bb78-8a0a2e801d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099a376e-5d75-4298-bb78-8a0a2e801d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3938b18b-0ea5-4678-b8aa-7dbbdd039cac', 'volume_name': 'volume-3938b18b-0ea5-4678-b8aa-7dbbdd039cac', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5653ba-dee5-4f50-84fa-9c1663bb6a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5653ba-dee5-4f50-84fa-9c1663bb6a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561a6ec4-2dc6-4cd2-b83d-9c7b0ebc7f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:36 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Volume 3938b18b-0ea5-4678-b8aa-7dbbdd039cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3938b18b-0ea5-4678-b8aa-7dbbdd039cac', 'volume_size': 1} Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-46061057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3938b18b-0ea5-4678-b8aa-7dbbdd039cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e660f9cf174122bad6ca06aa1b889b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:36Z,use_quota=True,user_id='e00952f6151e45278240b496156ee6af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Creating volume 3938b18b-0ea5-4678-b8aa-7dbbdd039cac {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:28:36 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:28:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3938b18b-0ea5-4678-b8aa-7dbbdd039cac 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:36 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3938b18b-0ea5-4678-b8aa-7dbbdd039cac 1073741824 Jul 07 17:28:36 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:37 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-740bbc95-be7c-4ae7-b5d1-670c0c15bc71 tempest-VolumesActionsTest-1842254613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-80ba9fc3-63e0-4419-a406-ef1521815444" returned: 0 in 0.844s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:37 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-740bbc95-be7c-4ae7-b5d1-670c0c15bc71 tempest-VolumesActionsTest-1842254613 None] Lock "cinder-quobyte-80ba9fc3-63e0-4419-a406-ef1521815444" released by "delete_volume" :: held 2.576s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:37 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-740bbc95-be7c-4ae7-b5d1-670c0c15bc71 tempest-VolumesActionsTest-1842254613 None] Created reservations ['d5e5c4ef-f2eb-4b98-a379-e08bf896cddb', '670e5065-4c03-4f22-a14f-28f7913bff86', '59e75915-92fc-4c9e-80d6-b59037f4813f', '28b29fa4-9087-4800-bc14-1933bc86851f'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:28:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-740bbc95-be7c-4ae7-b5d1-670c0c15bc71 tempest-VolumesActionsTest-1842254613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-740bbc95-be7c-4ae7-b5d1-670c0c15bc71 tempest-VolumesActionsTest-1842254613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-740bbc95-be7c-4ae7-b5d1-670c0c15bc71 tempest-VolumesActionsTest-1842254613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-740bbc95-be7c-4ae7-b5d1-670c0c15bc71 tempest-VolumesActionsTest-1842254613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-740bbc95-be7c-4ae7-b5d1-670c0c15bc71 tempest-VolumesActionsTest-1842254613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-740bbc95-be7c-4ae7-b5d1-670c0c15bc71 tempest-VolumesActionsTest-1842254613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:37 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:28:37 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:38 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3938b18b-0ea5-4678-b8aa-7dbbdd039cac 1073741824" returned: 0 in 1.787s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:38 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:UPDATE=107,cinder:INSERT=31,cinder:DELETE=9,cinder:SELECT=84 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:28:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3938b18b-0ea5-4678-b8aa-7dbbdd039cac {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:38 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3938b18b-0ea5-4678-b8aa-7dbbdd039cac Jul 07 17:28:38 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:38 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-740bbc95-be7c-4ae7-b5d1-670c0c15bc71 tempest-VolumesActionsTest-1842254613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.483s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:38 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-740bbc95-be7c-4ae7-b5d1-670c0c15bc71 tempest-VolumesActionsTest-1842254613 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:28:38 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-740bbc95-be7c-4ae7-b5d1-670c0c15bc71 tempest-VolumesActionsTest-1842254613 None] Deleted volume successfully. Jul 07 17:28:38 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-740bbc95-be7c-4ae7-b5d1-670c0c15bc71 tempest-VolumesActionsTest-1842254613 None] Lock "cinder-80ba9fc3-63e0-4419-a406-ef1521815444-delete_volume" released by "delete_volume" :: held 4.439s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Flow 'volume_create_manager' (be4f96d0-ec7d-4f98-b05f-81dd786be4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce895b05-007e-4e84-968d-4a6598a1ca24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce895b05-007e-4e84-968d-4a6598a1ca24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-535171226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ebf0669-7aab-49f1-a0b3-9f201be4739a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4738df9f3754a6c88c776a85e0ae158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:39Z,use_quota=True,user_id='92d2aa82d3b34104a4d65c0aad9d34ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9410fac7-234f-4fc2-890f-365ce2dbfa41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9410fac7-234f-4fc2-890f-365ce2dbfa41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6668a2-1d63-48ef-8531-7aad17bd0735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6668a2-1d63-48ef-8531-7aad17bd0735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ebf0669-7aab-49f1-a0b3-9f201be4739a', 'volume_name': 'volume-6ebf0669-7aab-49f1-a0b3-9f201be4739a', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (710a9bb4-ec25-48d7-bc89-deceaeb94796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (710a9bb4-ec25-48d7-bc89-deceaeb94796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b55580e-e53d-4e10-b287-d2986ca7330c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:39 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Volume 6ebf0669-7aab-49f1-a0b3-9f201be4739a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ebf0669-7aab-49f1-a0b3-9f201be4739a', 'volume_size': 1} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:39 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3938b18b-0ea5-4678-b8aa-7dbbdd039cac" returned: 0 in 1.186s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] <== create_volume: return (3141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.144s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.152s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-535171226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ebf0669-7aab-49f1-a0b3-9f201be4739a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4738df9f3754a6c88c776a85e0ae158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:39Z,use_quota=True,user_id='92d2aa82d3b34104a4d65c0aad9d34ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Creating volume 6ebf0669-7aab-49f1-a0b3-9f201be4739a {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:28:39 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ebf0669-7aab-49f1-a0b3-9f201be4739a 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:39 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ebf0669-7aab-49f1-a0b3-9f201be4739a 1073741824 Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561a6ec4-2dc6-4cd2-b83d-9c7b0ebc7f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3938b18b-0ea5-4678-b8aa-7dbbdd039cac', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:39 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a1afd5-9e5c-4990-847a-c67cf14d4179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:39 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Volume volume-3938b18b-0ea5-4678-b8aa-7dbbdd039cac (3938b18b-0ea5-4678-b8aa-7dbbdd039cac): created successfully Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a1afd5-9e5c-4990-847a-c67cf14d4179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Flow 'volume_create_manager' (aed5e36a-a9ce-4905-8933-488cba67e44c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:39 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-aef70647-2192-418f-849b-9f067f98d2fc tempest-VolumesNegativeTest-536484635 None] Created volume successfully. Jul 07 17:28:40 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-a293b428-dd2e-4013-998b-cd63454c3036 tempest-TestShelveInstance-2013394509 None] Terminate volume connection completed successfully. Jul 07 17:28:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-a293b428-dd2e-4013-998b-cd63454c3036 tempest-TestShelveInstance-2013394509 None] Deleting attachment 1039ecda-7a38-4059-b77f-a6b98dbb18c1. {{(pid=87303) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:28:40 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ebf0669-7aab-49f1-a0b3-9f201be4739a 1073741824" returned: 0 in 1.332s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ebf0669-7aab-49f1-a0b3-9f201be4739a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:41 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ebf0669-7aab-49f1-a0b3-9f201be4739a Jul 07 17:28:41 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:41 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-8bc716f6-8555-407c-ac8a-dd11446a9986 tempest-TestShelveInstance-2013394509 None] Acquiring lock "cinder-5200c5ee-e648-4843-9696-dea29b0ed66c-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:41 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-8bc716f6-8555-407c-ac8a-dd11446a9986 tempest-TestShelveInstance-2013394509 None] Lock "cinder-5200c5ee-e648-4843-9696-dea29b0ed66c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:41 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-8bc716f6-8555-407c-ac8a-dd11446a9986 tempest-TestShelveInstance-2013394509 None] Acquiring lock "cinder-quobyte-5200c5ee-e648-4843-9696-dea29b0ed66c" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:41 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-8bc716f6-8555-407c-ac8a-dd11446a9986 tempest-TestShelveInstance-2013394509 None] Lock "cinder-quobyte-5200c5ee-e648-4843-9696-dea29b0ed66c" acquired by "delete_volume" :: waited 0.031s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:41 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[83468e7c-588d-4296-b601-c9ca3741e0e9]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-8bc716f6-8555-407c-ac8a-dd11446a9986 tempest-TestShelveInstance-2013394509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:41 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c Jul 07 17:28:41 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:42 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ebf0669-7aab-49f1-a0b3-9f201be4739a" returned: 0 in 1.174s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] <== create_volume: return (2569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:28:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.572s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b55580e-e53d-4e10-b287-d2986ca7330c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ebf0669-7aab-49f1-a0b3-9f201be4739a', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1e499a-9c6f-4a03-83de-72b92b6bd773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:42 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Volume volume-6ebf0669-7aab-49f1-a0b3-9f201be4739a (6ebf0669-7aab-49f1-a0b3-9f201be4739a): created successfully Jul 07 17:28:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1e499a-9c6f-4a03-83de-72b92b6bd773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Flow 'volume_create_manager' (be4f96d0-ec7d-4f98-b05f-81dd786be4fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:42 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-8ca61271-0eab-47fa-a4bc-8a31717fc10e tempest-VolumesActionsTest-693965280 None] Created volume successfully. Jul 07 17:28:42 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-8bc716f6-8555-407c-ac8a-dd11446a9986 tempest-TestShelveInstance-2013394509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c" returned: 0 in 1.244s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-8bc716f6-8555-407c-ac8a-dd11446a9986 tempest-TestShelveInstance-2013394509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:42 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c Jul 07 17:28:42 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:43 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0bfd150b-db97-47ec-8854-177097487ec1 tempest-VolumesActionsTest-1842254613 None] Acquiring lock "cinder-6ebf0669-7aab-49f1-a0b3-9f201be4739a-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:43 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0bfd150b-db97-47ec-8854-177097487ec1 tempest-VolumesActionsTest-1842254613 None] Lock "cinder-6ebf0669-7aab-49f1-a0b3-9f201be4739a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:43 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0bfd150b-db97-47ec-8854-177097487ec1 tempest-VolumesActionsTest-1842254613 None] Acquiring lock "cinder-quobyte-6ebf0669-7aab-49f1-a0b3-9f201be4739a" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:43 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-8bc716f6-8555-407c-ac8a-dd11446a9986 tempest-TestShelveInstance-2013394509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c" returned: 1 in 0.976s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-8bc716f6-8555-407c-ac8a-dd11446a9986 tempest-TestShelveInstance-2013394509 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:28:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-8bc716f6-8555-407c-ac8a-dd11446a9986 tempest-TestShelveInstance-2013394509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:43 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0bfd150b-db97-47ec-8854-177097487ec1 tempest-VolumesActionsTest-1842254613 None] Lock "cinder-quobyte-6ebf0669-7aab-49f1-a0b3-9f201be4739a" acquired by "delete_volume" :: waited 0.036s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:43 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c Jul 07 17:28:43 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:43 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba70c1fc-cfe7-49cc-b702-6a85c276993b]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0bfd150b-db97-47ec-8854-177097487ec1 tempest-VolumesActionsTest-1842254613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ebf0669-7aab-49f1-a0b3-9f201be4739a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:43 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ebf0669-7aab-49f1-a0b3-9f201be4739a Jul 07 17:28:43 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:44 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-8bc716f6-8555-407c-ac8a-dd11446a9986 tempest-TestShelveInstance-2013394509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5200c5ee-e648-4843-9696-dea29b0ed66c" returned: 0 in 0.887s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:44 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-8bc716f6-8555-407c-ac8a-dd11446a9986 tempest-TestShelveInstance-2013394509 None] Lock "cinder-quobyte-5200c5ee-e648-4843-9696-dea29b0ed66c" released by "delete_volume" :: held 3.259s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:44 devstack cinder-volume[87303]: DEBUG cinder.quota [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-8bc716f6-8555-407c-ac8a-dd11446a9986 tempest-TestShelveInstance-2013394509 None] Created reservations ['27a55673-37c0-4345-bf5b-c15039ea3c8e', '9f974e97-2f91-4679-88ce-56538cd952d3', '559014ec-1e7e-447c-9727-b8be4155ba10', '27c20983-055f-47c0-8cf8-bcdcd96553d9'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:28:44 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0bfd150b-db97-47ec-8854-177097487ec1 tempest-VolumesActionsTest-1842254613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ebf0669-7aab-49f1-a0b3-9f201be4739a" returned: 0 in 1.009s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0bfd150b-db97-47ec-8854-177097487ec1 tempest-VolumesActionsTest-1842254613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ebf0669-7aab-49f1-a0b3-9f201be4739a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-8bc716f6-8555-407c-ac8a-dd11446a9986 tempest-TestShelveInstance-2013394509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-8bc716f6-8555-407c-ac8a-dd11446a9986 tempest-TestShelveInstance-2013394509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-8bc716f6-8555-407c-ac8a-dd11446a9986 tempest-TestShelveInstance-2013394509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-8bc716f6-8555-407c-ac8a-dd11446a9986 tempest-TestShelveInstance-2013394509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-8bc716f6-8555-407c-ac8a-dd11446a9986 tempest-TestShelveInstance-2013394509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-8bc716f6-8555-407c-ac8a-dd11446a9986 tempest-TestShelveInstance-2013394509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:44 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ebf0669-7aab-49f1-a0b3-9f201be4739a Jul 07 17:28:44 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:44 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:28:44 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:45 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0bfd150b-db97-47ec-8854-177097487ec1 tempest-VolumesActionsTest-1842254613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ebf0669-7aab-49f1-a0b3-9f201be4739a" returned: 0 in 0.894s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:45 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0bfd150b-db97-47ec-8854-177097487ec1 tempest-VolumesActionsTest-1842254613 None] Lock "cinder-quobyte-6ebf0669-7aab-49f1-a0b3-9f201be4739a" released by "delete_volume" :: held 1.960s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:45 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-8bc716f6-8555-407c-ac8a-dd11446a9986 tempest-TestShelveInstance-2013394509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.918s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:45 devstack cinder-volume[87303]: DEBUG cinder.manager [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-8bc716f6-8555-407c-ac8a-dd11446a9986 tempest-TestShelveInstance-2013394509 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:28:45 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-8bc716f6-8555-407c-ac8a-dd11446a9986 tempest-TestShelveInstance-2013394509 None] Deleted volume successfully. Jul 07 17:28:45 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-f8aafff1-fe31-41bf-a9e3-f3d28323a3ab req-8bc716f6-8555-407c-ac8a-dd11446a9986 tempest-TestShelveInstance-2013394509 None] Lock "cinder-5200c5ee-e648-4843-9696-dea29b0ed66c-delete_volume" released by "delete_volume" :: held 4.505s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:45 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-0bfd150b-db97-47ec-8854-177097487ec1 tempest-VolumesActionsTest-1842254613 None] Created reservations ['90072288-fa91-4aa3-8b48-4e45773784c4', '5da1599c-2d55-4cc0-90df-85a219b8cb4a', '423eefa6-346a-4af1-b2a9-a536f6c39369', '34d854bc-5226-47a1-8a5d-8f69c37189d3'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:28:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0bfd150b-db97-47ec-8854-177097487ec1 tempest-VolumesActionsTest-1842254613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0bfd150b-db97-47ec-8854-177097487ec1 tempest-VolumesActionsTest-1842254613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0bfd150b-db97-47ec-8854-177097487ec1 tempest-VolumesActionsTest-1842254613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0bfd150b-db97-47ec-8854-177097487ec1 tempest-VolumesActionsTest-1842254613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0bfd150b-db97-47ec-8854-177097487ec1 tempest-VolumesActionsTest-1842254613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0bfd150b-db97-47ec-8854-177097487ec1 tempest-VolumesActionsTest-1842254613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:45 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:28:45 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:46 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0bfd150b-db97-47ec-8854-177097487ec1 tempest-VolumesActionsTest-1842254613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.737s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:46 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-0bfd150b-db97-47ec-8854-177097487ec1 tempest-VolumesActionsTest-1842254613 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:28:46 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-0bfd150b-db97-47ec-8854-177097487ec1 tempest-VolumesActionsTest-1842254613 None] Deleted volume successfully. Jul 07 17:28:46 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0bfd150b-db97-47ec-8854-177097487ec1 tempest-VolumesActionsTest-1842254613 None] Lock "cinder-6ebf0669-7aab-49f1-a0b3-9f201be4739a-delete_volume" released by "delete_volume" :: held 3.069s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:47 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:28:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Flow 'volume_create_manager' (5951212d-e138-458c-9866-cb81556f124a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e32de4e-cf7f-4e49-b11c-d40b0db4c958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e32de4e-cf7f-4e49-b11c-d40b0db4c958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-890859899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ecac214-bad6-4770-bcbb-362b63b2cda5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4738df9f3754a6c88c776a85e0ae158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:48Z,use_quota=True,user_id='92d2aa82d3b34104a4d65c0aad9d34ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f1345f-2718-4ef3-b66f-720f35e812f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f1345f-2718-4ef3-b66f-720f35e812f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34933c85-59e1-4bfd-9ca6-8b4ec4cd1240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34933c85-59e1-4bfd-9ca6-8b4ec4cd1240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ecac214-bad6-4770-bcbb-362b63b2cda5', 'volume_name': 'volume-0ecac214-bad6-4770-bcbb-362b63b2cda5', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3620bbbc-6dcc-4d8f-b58e-2e07d8c4c28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3620bbbc-6dcc-4d8f-b58e-2e07d8c4c28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d56e76-b359-4a36-a0ee-1dce166df4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:47 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Volume 0ecac214-bad6-4770-bcbb-362b63b2cda5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ecac214-bad6-4770-bcbb-362b63b2cda5', 'volume_size': 1} Jul 07 17:28:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-890859899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ecac214-bad6-4770-bcbb-362b63b2cda5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4738df9f3754a6c88c776a85e0ae158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:48Z,use_quota=True,user_id='92d2aa82d3b34104a4d65c0aad9d34ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:28:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Creating volume 0ecac214-bad6-4770-bcbb-362b63b2cda5 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:28:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:28:47 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:28:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0ecac214-bad6-4770-bcbb-362b63b2cda5 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:47 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0ecac214-bad6-4770-bcbb-362b63b2cda5 1073741824 Jul 07 17:28:47 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:49 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0ecac214-bad6-4770-bcbb-362b63b2cda5 1073741824" returned: 0 in 1.287s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0ecac214-bad6-4770-bcbb-362b63b2cda5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:49 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0ecac214-bad6-4770-bcbb-362b63b2cda5 Jul 07 17:28:49 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:50 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0ecac214-bad6-4770-bcbb-362b63b2cda5" returned: 0 in 0.921s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] <== create_volume: return (2287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:28:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.290s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d56e76-b359-4a36-a0ee-1dce166df4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ecac214-bad6-4770-bcbb-362b63b2cda5', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef28ac3-a166-43aa-9c0a-e6cfa8d92cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:50 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Volume volume-0ecac214-bad6-4770-bcbb-362b63b2cda5 (0ecac214-bad6-4770-bcbb-362b63b2cda5): created successfully Jul 07 17:28:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef28ac3-a166-43aa-9c0a-e6cfa8d92cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Flow 'volume_create_manager' (5951212d-e138-458c-9866-cb81556f124a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:50 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5093a4b8-4289-4d5e-a5e3-649948295443 tempest-VolumesActionsTest-693965280 None] Created volume successfully. Jul 07 17:28:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1381b042-8d71-47ea-9768-54191fdb1e9c tempest-VolumesActionsTest-693965280 None] Acquiring lock "cinder-0ecac214-bad6-4770-bcbb-362b63b2cda5-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:52 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1381b042-8d71-47ea-9768-54191fdb1e9c tempest-VolumesActionsTest-693965280 None] Lock "cinder-0ecac214-bad6-4770-bcbb-362b63b2cda5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:52 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1381b042-8d71-47ea-9768-54191fdb1e9c tempest-VolumesActionsTest-693965280 None] Acquiring lock "cinder-quobyte-0ecac214-bad6-4770-bcbb-362b63b2cda5" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:28:52 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1381b042-8d71-47ea-9768-54191fdb1e9c tempest-VolumesActionsTest-693965280 None] Lock "cinder-quobyte-0ecac214-bad6-4770-bcbb-362b63b2cda5" acquired by "delete_volume" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:28:52 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0db952-f375-4bd8-b006-6aa86fe52e9e]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:28:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1381b042-8d71-47ea-9768-54191fdb1e9c tempest-VolumesActionsTest-693965280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0ecac214-bad6-4770-bcbb-362b63b2cda5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:52 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0ecac214-bad6-4770-bcbb-362b63b2cda5 Jul 07 17:28:52 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:53 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1381b042-8d71-47ea-9768-54191fdb1e9c tempest-VolumesActionsTest-693965280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0ecac214-bad6-4770-bcbb-362b63b2cda5" returned: 0 in 1.032s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1381b042-8d71-47ea-9768-54191fdb1e9c tempest-VolumesActionsTest-693965280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0ecac214-bad6-4770-bcbb-362b63b2cda5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:53 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0ecac214-bad6-4770-bcbb-362b63b2cda5 Jul 07 17:28:53 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:54 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1381b042-8d71-47ea-9768-54191fdb1e9c tempest-VolumesActionsTest-693965280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0ecac214-bad6-4770-bcbb-362b63b2cda5" returned: 0 in 0.844s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:54 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1381b042-8d71-47ea-9768-54191fdb1e9c tempest-VolumesActionsTest-693965280 None] Lock "cinder-quobyte-0ecac214-bad6-4770-bcbb-362b63b2cda5" released by "delete_volume" :: held 1.951s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:54 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-1381b042-8d71-47ea-9768-54191fdb1e9c tempest-VolumesActionsTest-693965280 None] Created reservations ['7ef6bfab-5d57-4245-adfb-afd8a2ae5999', 'b4c24cb7-9174-448d-a737-baf4fc63806d', 'ba8d7431-39fe-47ad-ad1d-37aca09b07f0', '0ac74623-6408-44b0-ae2c-e3d63c77f657'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:28:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1381b042-8d71-47ea-9768-54191fdb1e9c tempest-VolumesActionsTest-693965280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1381b042-8d71-47ea-9768-54191fdb1e9c tempest-VolumesActionsTest-693965280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:54 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1381b042-8d71-47ea-9768-54191fdb1e9c tempest-VolumesActionsTest-693965280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:54 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1381b042-8d71-47ea-9768-54191fdb1e9c tempest-VolumesActionsTest-693965280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1381b042-8d71-47ea-9768-54191fdb1e9c tempest-VolumesActionsTest-693965280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1381b042-8d71-47ea-9768-54191fdb1e9c tempest-VolumesActionsTest-693965280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:54 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:28:54 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Flow 'volume_create_manager' (cefba412-e08d-43eb-9873-63b27c4558a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3b0ad0-e05b-4f8f-9271-7f7eccd738e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3b0ad0-e05b-4f8f-9271-7f7eccd738e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1280059221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e6994a-2681-40c6-912d-a52eb5d30b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba109cf167ff489080e77c314e5e0343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:55Z,use_quota=True,user_id='4088f72dbd774c3d8c29e00552631f08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2910b9e3-ef55-4202-9170-fca5aa85df3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2910b9e3-ef55-4202-9170-fca5aa85df3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a16b542-9cd0-4bef-a0ef-66b5a8fbf5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a16b542-9cd0-4bef-a0ef-66b5a8fbf5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97e6994a-2681-40c6-912d-a52eb5d30b2b', 'volume_name': 'volume-97e6994a-2681-40c6-912d-a52eb5d30b2b', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17b1171-add1-4203-ae76-fcc651d23645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17b1171-add1-4203-ae76-fcc651d23645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae9e0c5-3804-461c-8cb7-caf3dacc45f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:55 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Volume 97e6994a-2681-40c6-912d-a52eb5d30b2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97e6994a-2681-40c6-912d-a52eb5d30b2b', 'volume_size': 1} Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1280059221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e6994a-2681-40c6-912d-a52eb5d30b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba109cf167ff489080e77c314e5e0343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:28:55Z,use_quota=True,user_id='4088f72dbd774c3d8c29e00552631f08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Creating volume 97e6994a-2681-40c6-912d-a52eb5d30b2b {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:28:55 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97e6994a-2681-40c6-912d-a52eb5d30b2b 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:55 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97e6994a-2681-40c6-912d-a52eb5d30b2b 1073741824 Jul 07 17:28:55 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:55 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1381b042-8d71-47ea-9768-54191fdb1e9c tempest-VolumesActionsTest-693965280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.456s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-1381b042-8d71-47ea-9768-54191fdb1e9c tempest-VolumesActionsTest-693965280 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:28:55 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-1381b042-8d71-47ea-9768-54191fdb1e9c tempest-VolumesActionsTest-693965280 None] Deleted volume successfully. Jul 07 17:28:55 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1381b042-8d71-47ea-9768-54191fdb1e9c tempest-VolumesActionsTest-693965280 None] Lock "cinder-0ecac214-bad6-4770-bcbb-362b63b2cda5-delete_volume" released by "delete_volume" :: held 3.796s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:28:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:28:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:28:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:28:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:28:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:28:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:56 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:28:56 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:56 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97e6994a-2681-40c6-912d-a52eb5d30b2b 1073741824" returned: 0 in 1.437s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97e6994a-2681-40c6-912d-a52eb5d30b2b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:28:56 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97e6994a-2681-40c6-912d-a52eb5d30b2b Jul 07 17:28:56 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:28:58 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.438s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:58 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:28:58 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:28:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:28:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:28:58 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Jul 07 17:28:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97e6994a-2681-40c6-912d-a52eb5d30b2b" returned: 0 in 1.333s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:28:58 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] <== create_volume: return (2883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:28:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.891s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:28:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae9e0c5-3804-461c-8cb7-caf3dacc45f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97e6994a-2681-40c6-912d-a52eb5d30b2b', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da64649e-5d4e-4188-8af4-8715a041de66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:28:58 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Volume volume-97e6994a-2681-40c6-912d-a52eb5d30b2b (97e6994a-2681-40c6-912d-a52eb5d30b2b): created successfully Jul 07 17:28:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da64649e-5d4e-4188-8af4-8715a041de66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:28:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Flow 'volume_create_manager' (cefba412-e08d-43eb-9873-63b27c4558a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:28:58 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-0afd2bee-fb86-47a2-9357-2ed28f4a933a tempest-AttachVolumeNegativeTest-1635603288 None] Created volume successfully. Jul 07 17:29:04 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=79,cinder:INSERT=29,cinder:UPDATE=112,cinder:DELETE=10 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:29:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-928ecc44-0f7b-4b31-854d-70278e436993 req-534a420a-d6ba-4ad3-923f-8d85efac84dd tempest-AttachVolumeNegativeTest-1635603288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-928ecc44-0f7b-4b31-854d-70278e436993 req-534a420a-d6ba-4ad3-923f-8d85efac84dd tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:04 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Flow 'volume_create_manager' (83a1636d-30bf-4bd3-a3bf-aed0bf202c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef80b5e0-ca40-4fcd-8eaf-2935f5b86f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:04 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[080f6efe-cd98-4ebe-9fab-6ecdecfecbb4]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-928ecc44-0f7b-4b31-854d-70278e436993 req-534a420a-d6ba-4ad3-923f-8d85efac84dd tempest-AttachVolumeNegativeTest-1635603288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97e6994a-2681-40c6-912d-a52eb5d30b2b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef80b5e0-ca40-4fcd-8eaf-2935f5b86f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-79960308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5883a5da-6f77-4a9d-b538-3b88d42ad276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7dc45dc92445329c78803a007c3120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:04Z,use_quota=True,user_id='e9d5a3b6a97d444bb1187b792dda84fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78fbf06-28d3-47ba-a0e3-dd4278c6e703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78fbf06-28d3-47ba-a0e3-dd4278c6e703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e00d67-0bee-4b93-b9ee-06c5003bb1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e00d67-0bee-4b93-b9ee-06c5003bb1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5883a5da-6f77-4a9d-b538-3b88d42ad276', 'volume_name': 'volume-5883a5da-6f77-4a9d-b538-3b88d42ad276', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205da292-8366-4fce-9c5a-b0b27fa2f45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205da292-8366-4fce-9c5a-b0b27fa2f45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff8ffe6-743b-4830-931b-98f8faac231e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:04 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Volume 5883a5da-6f77-4a9d-b538-3b88d42ad276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5883a5da-6f77-4a9d-b538-3b88d42ad276', 'volume_size': 1} Jul 07 17:29:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:04 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97e6994a-2681-40c6-912d-a52eb5d30b2b Jul 07 17:29:04 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:05 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-928ecc44-0f7b-4b31-854d-70278e436993 req-534a420a-d6ba-4ad3-923f-8d85efac84dd tempest-AttachVolumeNegativeTest-1635603288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97e6994a-2681-40c6-912d-a52eb5d30b2b" returned: 0 in 1.021s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-928ecc44-0f7b-4b31-854d-70278e436993 req-534a420a-d6ba-4ad3-923f-8d85efac84dd tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.097s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.899s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-79960308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5883a5da-6f77-4a9d-b538-3b88d42ad276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7dc45dc92445329c78803a007c3120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:04Z,use_quota=True,user_id='e9d5a3b6a97d444bb1187b792dda84fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:29:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Creating volume 5883a5da-6f77-4a9d-b538-3b88d42ad276 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:29:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:05 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:29:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:05 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 1073741824 Jul 07 17:29:05 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-928ecc44-0f7b-4b31-854d-70278e436993 req-534a420a-d6ba-4ad3-923f-8d85efac84dd tempest-AttachVolumeNegativeTest-1635603288 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2', 'name': 'volume-97e6994a-2681-40c6-912d-a52eb5d30b2b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf959750-4cb0-4195-8886-4effc0c23937', 'enforce_multipath': True} {{(pid=87303) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:29:05 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-928ecc44-0f7b-4b31-854d-70278e436993 req-534a420a-d6ba-4ad3-923f-8d85efac84dd tempest-AttachVolumeNegativeTest-1635603288 None] attachment_update completed successfully. Jul 07 17:29:06 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 1073741824" returned: 0 in 1.329s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:06 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 Jul 07 17:29:06 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:07 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276" returned: 0 in 0.881s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] <== create_volume: return (2279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.283s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff8ffe6-743b-4830-931b-98f8faac231e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5883a5da-6f77-4a9d-b538-3b88d42ad276', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b7f148-d3d5-4ef5-b229-37c4ac02f283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:07 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Volume volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 (5883a5da-6f77-4a9d-b538-3b88d42ad276): created successfully Jul 07 17:29:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b7f148-d3d5-4ef5-b229-37c4ac02f283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Flow 'volume_create_manager' (83a1636d-30bf-4bd3-a3bf-aed0bf202c33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:07 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b682daa0-a532-4998-bad3-011fa55876bc tempest-VolumeDependencyTests-1330000129 None] Created volume successfully. Jul 07 17:29:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-511e2b4d-9d23-4a71-b31a-53a957899ae3 tempest-VolumeDependencyTests-1330000129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-511e2b4d-9d23-4a71-b31a-53a957899ae3 tempest-VolumeDependencyTests-1330000129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-511e2b4d-9d23-4a71-b31a-53a957899ae3 tempest-VolumeDependencyTests-1330000129 None] Creating offline snapshot b6e87064-9baf-4d48-8af3-89d505282176 of volume 5883a5da-6f77-4a9d-b538-3b88d42ad276 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:29:08 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[239be636-7544-4367-8c42-56b880b69d57]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-511e2b4d-9d23-4a71-b31a-53a957899ae3 tempest-VolumeDependencyTests-1330000129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:08 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 Jul 07 17:29:08 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:09 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-511e2b4d-9d23-4a71-b31a-53a957899ae3 tempest-VolumeDependencyTests-1330000129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276" returned: 0 in 1.057s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-511e2b4d-9d23-4a71-b31a-53a957899ae3 tempest-VolumeDependencyTests-1330000129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.b6e87064-9baf-4d48-8af3-89d505282176 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:09 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.b6e87064-9baf-4d48-8af3-89d505282176 1G Jul 07 17:29:09 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:11 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-511e2b4d-9d23-4a71-b31a-53a957899ae3 tempest-VolumeDependencyTests-1330000129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.b6e87064-9baf-4d48-8af3-89d505282176 1G" returned: 0 in 1.254s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-511e2b4d-9d23-4a71-b31a-53a957899ae3 tempest-VolumeDependencyTests-1330000129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.b6e87064-9baf-4d48-8af3-89d505282176 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:11 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.b6e87064-9baf-4d48-8af3-89d505282176 Jul 07 17:29:11 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:11 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-511e2b4d-9d23-4a71-b31a-53a957899ae3 tempest-VolumeDependencyTests-1330000129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.b6e87064-9baf-4d48-8af3-89d505282176" returned: 0 in 0.875s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:11 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-511e2b4d-9d23-4a71-b31a-53a957899ae3 tempest-VolumeDependencyTests-1330000129 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.b6e87064-9baf-4d48-8af3-89d505282176 is being set with open permissions: ugo+rw Jul 07 17:29:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-511e2b4d-9d23-4a71-b31a-53a957899ae3 tempest-VolumeDependencyTests-1330000129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.b6e87064-9baf-4d48-8af3-89d505282176 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:11 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.b6e87064-9baf-4d48-8af3-89d505282176 Jul 07 17:29:11 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:12 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-f3394311-54e7-4569-b608-97c31b064311 req-4f9ebc6b-90c9-40af-9928-bc8aa9800b2d tempest-AttachVolumeNegativeTest-1635603288 None] Terminate volume connection completed successfully. Jul 07 17:29:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-f3394311-54e7-4569-b608-97c31b064311 req-4f9ebc6b-90c9-40af-9928-bc8aa9800b2d tempest-AttachVolumeNegativeTest-1635603288 None] Deleting attachment cf959750-4cb0-4195-8886-4effc0c23937. {{(pid=87303) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:29:12 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-511e2b4d-9d23-4a71-b31a-53a957899ae3 tempest-VolumeDependencyTests-1330000129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.b6e87064-9baf-4d48-8af3-89d505282176" returned: 0 in 0.915s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-511e2b4d-9d23-4a71-b31a-53a957899ae3 tempest-VolumeDependencyTests-1330000129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:12 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.info Jul 07 17:29:12 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:14 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-511e2b4d-9d23-4a71-b31a-53a957899ae3 tempest-VolumeDependencyTests-1330000129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.info" returned: 0 in 1.308s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:14 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-511e2b4d-9d23-4a71-b31a-53a957899ae3 tempest-VolumeDependencyTests-1330000129 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.info is being set with open permissions: ugo+rw Jul 07 17:29:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-511e2b4d-9d23-4a71-b31a-53a957899ae3 tempest-VolumeDependencyTests-1330000129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:14 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.info Jul 07 17:29:14 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:14 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Flow 'volume_create_manager' (4831c586-4509-46e3-88c0-ad8561b76cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81abfd6e-e1ab-46c7-8a8b-5ab1f1b5a4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81abfd6e-e1ab-46c7-8a8b-5ab1f1b5a4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-479280486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb11890-883e-4e3b-a745-705a34470564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c202f549e174d289d5563f363b6871c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:14Z,use_quota=True,user_id='9223ba80a80a42bca234e69a1ae6395b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab37017-02fe-47f8-aabe-641558b80d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab37017-02fe-47f8-aabe-641558b80d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec1245a-d50b-4a3b-a1ac-4f57b3fa4e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec1245a-d50b-4a3b-a1ac-4f57b3fa4e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eb11890-883e-4e3b-a745-705a34470564', 'volume_name': 'volume-5eb11890-883e-4e3b-a745-705a34470564', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387e8a96-2416-4ddd-b951-c17760ca83f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387e8a96-2416-4ddd-b951-c17760ca83f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271e159d-4197-4434-95cf-a1a6a517e303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:14 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Volume 5eb11890-883e-4e3b-a745-705a34470564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eb11890-883e-4e3b-a745-705a34470564', 'volume_size': 1} Jul 07 17:29:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:15 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-511e2b4d-9d23-4a71-b31a-53a957899ae3 tempest-VolumeDependencyTests-1330000129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.info" returned: 0 in 0.932s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-511e2b4d-9d23-4a71-b31a-53a957899ae3 tempest-VolumeDependencyTests-1330000129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.492s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.582s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-479280486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb11890-883e-4e3b-a745-705a34470564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c202f549e174d289d5563f363b6871c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:14Z,use_quota=True,user_id='9223ba80a80a42bca234e69a1ae6395b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:29:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Creating volume 5eb11890-883e-4e3b-a745-705a34470564 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:29:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:15 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:29:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5eb11890-883e-4e3b-a745-705a34470564 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:15 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5eb11890-883e-4e3b-a745-705a34470564 1073741824 Jul 07 17:29:15 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:15 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-511e2b4d-9d23-4a71-b31a-53a957899ae3 tempest-VolumeDependencyTests-1330000129 None] Create snapshot completed successfully Jul 07 17:29:16 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5eb11890-883e-4e3b-a745-705a34470564 1073741824" returned: 0 in 0.986s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5eb11890-883e-4e3b-a745-705a34470564 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:16 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5eb11890-883e-4e3b-a745-705a34470564 Jul 07 17:29:16 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Flow 'volume_create_manager' (b8258a15-fca1-4369-8bc3-c5727be6438d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f585ee-2a0a-4db0-9ae4-2a4fba23055f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f585ee-2a0a-4db0-9ae4-2a4fba23055f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-64813228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5d0ec2-67e3-435a-8b73-96b00a01f498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7dc45dc92445329c78803a007c3120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b6e87064-9baf-4d48-8af3-89d505282176,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:17Z,use_quota=True,user_id='e9d5a3b6a97d444bb1187b792dda84fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f3105c-c284-4338-93d8-668e6a680879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f3105c-c284-4338-93d8-668e6a680879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (379bf8dc-4e68-436f-b09e-3736eaebdf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (379bf8dc-4e68-436f-b09e-3736eaebdf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4f5d0ec2-67e3-435a-8b73-96b00a01f498', 'volume_name': 'volume-4f5d0ec2-67e3-435a-8b73-96b00a01f498', 'volume_size': 1, 'snapshot_id': 'b6e87064-9baf-4d48-8af3-89d505282176'}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1520a4a-e6db-4bc6-9c18-43cd7d55106f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1520a4a-e6db-4bc6-9c18-43cd7d55106f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbeec15d-548f-4d2d-87af-d2157b8982a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:17 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Volume 4f5d0ec2-67e3-435a-8b73-96b00a01f498: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4f5d0ec2-67e3-435a-8b73-96b00a01f498', 'volume_size': 1, 'snapshot_id': 'b6e87064-9baf-4d48-8af3-89d505282176'} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:17 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5eb11890-883e-4e3b-a745-705a34470564" returned: 0 in 1.125s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] <== create_volume: return (2164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.169s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.059s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Acquiring lock "cinder-quobyte-b6e87064-9baf-4d48-8af3-89d505282176-4f5d0ec2-67e3-435a-8b73-96b00a01f498" by "_create_volume_from_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271e159d-4197-4434-95cf-a1a6a517e303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eb11890-883e-4e3b-a745-705a34470564', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bfcd92e-5636-4c19-bb35-a2e112e38c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Lock "cinder-quobyte-b6e87064-9baf-4d48-8af3-89d505282176-4f5d0ec2-67e3-435a-8b73-96b00a01f498" acquired by "_create_volume_from_snapshot" :: waited 0.054s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Creating volume 4f5d0ec2-67e3-435a-8b73-96b00a01f498 from snapshot b6e87064-9baf-4d48-8af3-89d505282176 {{(pid=87303) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Acquiring lock "cinder-quobyte-4f5d0ec2-67e3-435a-8b73-96b00a01f498" by "_copy_volume_from_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:17 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Volume volume-5eb11890-883e-4e3b-a745-705a34470564 (5eb11890-883e-4e3b-a745-705a34470564): created successfully Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bfcd92e-5636-4c19-bb35-a2e112e38c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Flow 'volume_create_manager' (4831c586-4509-46e3-88c0-ad8561b76cf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Lock "cinder-quobyte-4f5d0ec2-67e3-435a-8b73-96b00a01f498" acquired by "_copy_volume_from_snapshot" :: waited 0.055s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] snapshot: b6e87064-9baf-4d48-8af3-89d505282176, volume: 4f5d0ec2-67e3-435a-8b73-96b00a01f498, {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:29:17 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-01d2d759-1624-44c9-a356-56e151259be2 tempest-VolumesListAdminTestJSON-1558901959 None] Created volume successfully. Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[995ba734-3b83-4ce0-ba24-5168e2a997a7]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.b6e87064-9baf-4d48-8af3-89d505282176 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:17 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.b6e87064-9baf-4d48-8af3-89d505282176 Jul 07 17:29:17 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:18 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.b6e87064-9baf-4d48-8af3-89d505282176" returned: 0 in 1.258s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:18 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5883a5da-6f77-4a9d-b538-3b88d42ad276(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:29:18 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:29:18 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Creating direct copy from snapshot {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:29:18 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a1b48c-b049-4ff6-a873-fd3bf3f08c61]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:18 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e25c258f-48df-40b6-bbe6-3b8249f451fc tempest-VolumesNegativeTest-536484635 None] Acquiring lock "cinder-3938b18b-0ea5-4678-b8aa-7dbbdd039cac-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e25c258f-48df-40b6-bbe6-3b8249f451fc tempest-VolumesNegativeTest-536484635 None] Lock "cinder-3938b18b-0ea5-4678-b8aa-7dbbdd039cac-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:19 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 Jul 07 17:29:19 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e25c258f-48df-40b6-bbe6-3b8249f451fc tempest-VolumesNegativeTest-536484635 None] Acquiring lock "cinder-quobyte-3938b18b-0ea5-4678-b8aa-7dbbdd039cac" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e25c258f-48df-40b6-bbe6-3b8249f451fc tempest-VolumesNegativeTest-536484635 None] Lock "cinder-quobyte-3938b18b-0ea5-4678-b8aa-7dbbdd039cac" acquired by "delete_volume" :: waited 0.036s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:19 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b0f8f7-12d1-40db-817f-627174de1860]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e25c258f-48df-40b6-bbe6-3b8249f451fc tempest-VolumesNegativeTest-536484635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3938b18b-0ea5-4678-b8aa-7dbbdd039cac {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:19 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3938b18b-0ea5-4678-b8aa-7dbbdd039cac Jul 07 17:29:19 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:19 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Flow 'volume_create_manager' (b11931b6-8d10-4b42-b3f3-b2ed1524caa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560be4d2-789c-48b6-96a2-90e63a5e5f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560be4d2-789c-48b6-96a2-90e63a5e5f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2090023923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d804a177-29f3-4ab0-bab7-579809935112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c202f549e174d289d5563f363b6871c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:19Z,use_quota=True,user_id='9223ba80a80a42bca234e69a1ae6395b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6b4d2a-79f2-4534-a05a-6bd9e2533971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6b4d2a-79f2-4534-a05a-6bd9e2533971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf85185-9362-43e2-9dad-5d1171e95faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf85185-9362-43e2-9dad-5d1171e95faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd804a177-29f3-4ab0-bab7-579809935112', 'volume_name': 'volume-d804a177-29f3-4ab0-bab7-579809935112', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f888f31-cce1-428b-b2ba-8c531e82bbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f888f31-cce1-428b-b2ba-8c531e82bbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef903a1-b7a7-43a3-ae28-443595b0031a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:19 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Volume d804a177-29f3-4ab0-bab7-579809935112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d804a177-29f3-4ab0-bab7-579809935112', 'volume_size': 1} Jul 07 17:29:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:20 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276" returned: 0 in 1.152s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:20 devstack cinder-volume[87303]: DEBUG cinder.utils [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Path /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f5d0ec2-67e3-435a-8b73-96b00a01f498 not found in is_blk_device check {{(pid=87303) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:29:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f5d0ec2-67e3-435a-8b73-96b00a01f498 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:20 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f5d0ec2-67e3-435a-8b73-96b00a01f498 Jul 07 17:29:20 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:20 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e25c258f-48df-40b6-bbe6-3b8249f451fc tempest-VolumesNegativeTest-536484635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3938b18b-0ea5-4678-b8aa-7dbbdd039cac" returned: 0 in 1.041s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e25c258f-48df-40b6-bbe6-3b8249f451fc tempest-VolumesNegativeTest-536484635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3938b18b-0ea5-4678-b8aa-7dbbdd039cac {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:20 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3938b18b-0ea5-4678-b8aa-7dbbdd039cac Jul 07 17:29:20 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:21 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e25c258f-48df-40b6-bbe6-3b8249f451fc tempest-VolumesNegativeTest-536484635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3938b18b-0ea5-4678-b8aa-7dbbdd039cac" returned: 0 in 0.875s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e25c258f-48df-40b6-bbe6-3b8249f451fc tempest-VolumesNegativeTest-536484635 None] Lock "cinder-quobyte-3938b18b-0ea5-4678-b8aa-7dbbdd039cac" released by "delete_volume" :: held 1.979s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:21 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-e25c258f-48df-40b6-bbe6-3b8249f451fc tempest-VolumesNegativeTest-536484635 None] Created reservations ['e3cb7590-48ca-4417-a339-a68e1c377c74', '946ae63d-38f6-42c3-b9fe-42ccb3457688', '2179be7f-6811-42b4-bea0-02e9b31937a2', '8cef567d-2714-4e08-87d6-a0e77fb24276'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e25c258f-48df-40b6-bbe6-3b8249f451fc tempest-VolumesNegativeTest-536484635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e25c258f-48df-40b6-bbe6-3b8249f451fc tempest-VolumesNegativeTest-536484635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e25c258f-48df-40b6-bbe6-3b8249f451fc tempest-VolumesNegativeTest-536484635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e25c258f-48df-40b6-bbe6-3b8249f451fc tempest-VolumesNegativeTest-536484635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e25c258f-48df-40b6-bbe6-3b8249f451fc tempest-VolumesNegativeTest-536484635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e25c258f-48df-40b6-bbe6-3b8249f451fc tempest-VolumesNegativeTest-536484635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:21 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:29:21 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:23 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e25c258f-48df-40b6-bbe6-3b8249f451fc tempest-VolumesNegativeTest-536484635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 2.103s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:23 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-e25c258f-48df-40b6-bbe6-3b8249f451fc tempest-VolumesNegativeTest-536484635 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:23 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-e25c258f-48df-40b6-bbe6-3b8249f451fc tempest-VolumesNegativeTest-536484635 None] Deleted volume successfully. Jul 07 17:29:23 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e25c258f-48df-40b6-bbe6-3b8249f451fc tempest-VolumesNegativeTest-536484635 None] Lock "cinder-3938b18b-0ea5-4678-b8aa-7dbbdd039cac-delete_volume" released by "delete_volume" :: held 4.637s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:26 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f5d0ec2-67e3-435a-8b73-96b00a01f498" returned: 0 in 6.336s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:26 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de36ebc-227f-4fb2-abac-41dad6e07cac]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:26 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 Jul 07 17:29:26 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-41e3928a-70c7-404a-a318-c64639309e6f tempest-AttachVolumeNegativeTest-1635603288 None] Acquiring lock "cinder-97e6994a-2681-40c6-912d-a52eb5d30b2b-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-41e3928a-70c7-404a-a318-c64639309e6f tempest-AttachVolumeNegativeTest-1635603288 None] Lock "cinder-97e6994a-2681-40c6-912d-a52eb5d30b2b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-41e3928a-70c7-404a-a318-c64639309e6f tempest-AttachVolumeNegativeTest-1635603288 None] Acquiring lock "cinder-quobyte-97e6994a-2681-40c6-912d-a52eb5d30b2b" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-41e3928a-70c7-404a-a318-c64639309e6f tempest-AttachVolumeNegativeTest-1635603288 None] Lock "cinder-quobyte-97e6994a-2681-40c6-912d-a52eb5d30b2b" acquired by "delete_volume" :: waited 0.029s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:26 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[10787e2a-d6c2-4e21-a135-90a4be24e98b]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-41e3928a-70c7-404a-a318-c64639309e6f tempest-AttachVolumeNegativeTest-1635603288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97e6994a-2681-40c6-912d-a52eb5d30b2b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:26 devstack sudo[98514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97e6994a-2681-40c6-912d-a52eb5d30b2b Jul 07 17:29:26 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:27 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276" returned: 0 in 1.366s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:27 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Image conversion details: src /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276, size 1024.00 MB, duration 6.34 sec, destination /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f5d0ec2-67e3-435a-8b73-96b00a01f498 {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:29:27 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Converted 1024.00 MB image at 161.59 MB/s Jul 07 17:29:27 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f5d0ec2-67e3-435a-8b73-96b00a01f498 is being set with open permissions: ugo+rw Jul 07 17:29:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f5d0ec2-67e3-435a-8b73-96b00a01f498 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:27 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f5d0ec2-67e3-435a-8b73-96b00a01f498 Jul 07 17:29:27 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:27 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-41e3928a-70c7-404a-a318-c64639309e6f tempest-AttachVolumeNegativeTest-1635603288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97e6994a-2681-40c6-912d-a52eb5d30b2b" returned: 0 in 1.013s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-41e3928a-70c7-404a-a318-c64639309e6f tempest-AttachVolumeNegativeTest-1635603288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97e6994a-2681-40c6-912d-a52eb5d30b2b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:27 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97e6994a-2681-40c6-912d-a52eb5d30b2b Jul 07 17:29:27 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:28 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-41e3928a-70c7-404a-a318-c64639309e6f tempest-AttachVolumeNegativeTest-1635603288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97e6994a-2681-40c6-912d-a52eb5d30b2b" returned: 0 in 0.771s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-41e3928a-70c7-404a-a318-c64639309e6f tempest-AttachVolumeNegativeTest-1635603288 None] Lock "cinder-quobyte-97e6994a-2681-40c6-912d-a52eb5d30b2b" released by "delete_volume" :: held 1.852s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:28 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f5d0ec2-67e3-435a-8b73-96b00a01f498" returned: 0 in 0.851s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Lock "cinder-quobyte-4f5d0ec2-67e3-435a-8b73-96b00a01f498" released by "_copy_volume_from_snapshot" :: held 11.138s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Lock "cinder-quobyte-b6e87064-9baf-4d48-8af3-89d505282176-4f5d0ec2-67e3-435a-8b73-96b00a01f498" released by "_create_volume_from_snapshot" :: held 11.224s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.280s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.999s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2090023923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d804a177-29f3-4ab0-bab7-579809935112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c202f549e174d289d5563f363b6871c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:19Z,use_quota=True,user_id='9223ba80a80a42bca234e69a1ae6395b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Creating volume d804a177-29f3-4ab0-bab7-579809935112 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:28 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d804a177-29f3-4ab0-bab7-579809935112 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:28 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d804a177-29f3-4ab0-bab7-579809935112 1073741824 Jul 07 17:29:28 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbeec15d-548f-4d2d-87af-d2157b8982a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f5d0ec2-67e3-435a-8b73-96b00a01f498', 'volume_size': 1, 'snapshot_id': 'b6e87064-9baf-4d48-8af3-89d505282176'}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3160f668-3fc6-44fb-982c-4e73ca0bb714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-41e3928a-70c7-404a-a318-c64639309e6f tempest-AttachVolumeNegativeTest-1635603288 None] Created reservations ['8b89e06f-cc0f-44fe-af4c-219fa8de1f23', '0be5dcd2-fac3-45ce-aa13-de39758a90b4', 'f74e571d-e55d-4bd4-a794-7f9faeb8c664', '3e724e05-2221-4b5b-bd8c-e68a6d316e37'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:28 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Volume volume-4f5d0ec2-67e3-435a-8b73-96b00a01f498 (4f5d0ec2-67e3-435a-8b73-96b00a01f498): created successfully Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3160f668-3fc6-44fb-982c-4e73ca0bb714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Flow 'volume_create_manager' (b8258a15-fca1-4369-8bc3-c5727be6438d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:28 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-798f1f08-6daf-45ba-9477-c7a8fd49c580 tempest-VolumeDependencyTests-1330000129 None] Created volume successfully. Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-41e3928a-70c7-404a-a318-c64639309e6f tempest-AttachVolumeNegativeTest-1635603288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-41e3928a-70c7-404a-a318-c64639309e6f tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-41e3928a-70c7-404a-a318-c64639309e6f tempest-AttachVolumeNegativeTest-1635603288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-41e3928a-70c7-404a-a318-c64639309e6f tempest-AttachVolumeNegativeTest-1635603288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-41e3928a-70c7-404a-a318-c64639309e6f tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-41e3928a-70c7-404a-a318-c64639309e6f tempest-AttachVolumeNegativeTest-1635603288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:28 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:29:28 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a390f173-b0f6-42c7-8e26-6695a1955b39 tempest-AttachVolumeNegativeTest-1635603288 None] Acquiring lock "cinder-ce56bbd0-60bf-4361-bace-62452585d086-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a390f173-b0f6-42c7-8e26-6695a1955b39 tempest-AttachVolumeNegativeTest-1635603288 None] Lock "cinder-ce56bbd0-60bf-4361-bace-62452585d086-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a390f173-b0f6-42c7-8e26-6695a1955b39 tempest-AttachVolumeNegativeTest-1635603288 None] Acquiring lock "cinder-quobyte-ce56bbd0-60bf-4361-bace-62452585d086" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a390f173-b0f6-42c7-8e26-6695a1955b39 tempest-AttachVolumeNegativeTest-1635603288 None] Lock "cinder-quobyte-ce56bbd0-60bf-4361-bace-62452585d086" acquired by "delete_volume" :: waited 0.020s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:29 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d859da9-91a3-4ccf-816b-c24fb6285a7e]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a390f173-b0f6-42c7-8e26-6695a1955b39 tempest-AttachVolumeNegativeTest-1635603288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ce56bbd0-60bf-4361-bace-62452585d086 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:29 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ce56bbd0-60bf-4361-bace-62452585d086 Jul 07 17:29:29 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5262e0a3-7b0a-4c1d-b8c7-0057e7937c93 tempest-VolumeDependencyTests-1330000129 None] Acquiring lock "cinder-b6e87064-9baf-4d48-8af3-89d505282176-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5262e0a3-7b0a-4c1d-b8c7-0057e7937c93 tempest-VolumeDependencyTests-1330000129 None] Lock "cinder-b6e87064-9baf-4d48-8af3-89d505282176-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5262e0a3-7b0a-4c1d-b8c7-0057e7937c93 tempest-VolumeDependencyTests-1330000129 None] Acquiring lock "cinder-quobyte-5883a5da-6f77-4a9d-b538-3b88d42ad276" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5262e0a3-7b0a-4c1d-b8c7-0057e7937c93 tempest-VolumeDependencyTests-1330000129 None] Lock "cinder-quobyte-5883a5da-6f77-4a9d-b538-3b88d42ad276" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5262e0a3-7b0a-4c1d-b8c7-0057e7937c93 tempest-VolumeDependencyTests-1330000129 None] Acquiring lock "cinder-quobyte-b6e87064-9baf-4d48-8af3-89d505282176" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5262e0a3-7b0a-4c1d-b8c7-0057e7937c93 tempest-VolumeDependencyTests-1330000129 None] Lock "cinder-quobyte-b6e87064-9baf-4d48-8af3-89d505282176" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-5262e0a3-7b0a-4c1d-b8c7-0057e7937c93 tempest-VolumeDependencyTests-1330000129 None] Deleting offline snapshot b6e87064-9baf-4d48-8af3-89d505282176 of volume 5883a5da-6f77-4a9d-b538-3b88d42ad276 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:29:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-5262e0a3-7b0a-4c1d-b8c7-0057e7937c93 tempest-VolumeDependencyTests-1330000129 None] snapshot_file for this snap is: volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.b6e87064-9baf-4d48-8af3-89d505282176 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:29:29 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[49522179-c1bc-495a-9feb-9975f4b6ab74]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5262e0a3-7b0a-4c1d-b8c7-0057e7937c93 tempest-VolumeDependencyTests-1330000129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.b6e87064-9baf-4d48-8af3-89d505282176 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:30 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-41e3928a-70c7-404a-a318-c64639309e6f tempest-AttachVolumeNegativeTest-1635603288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.074s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:30 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-41e3928a-70c7-404a-a318-c64639309e6f tempest-AttachVolumeNegativeTest-1635603288 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:30 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-41e3928a-70c7-404a-a318-c64639309e6f tempest-AttachVolumeNegativeTest-1635603288 None] Deleted volume successfully. Jul 07 17:29:30 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-41e3928a-70c7-404a-a318-c64639309e6f tempest-AttachVolumeNegativeTest-1635603288 None] Lock "cinder-97e6994a-2681-40c6-912d-a52eb5d30b2b-delete_volume" released by "delete_volume" :: held 3.410s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:30 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.b6e87064-9baf-4d48-8af3-89d505282176 Jul 07 17:29:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d804a177-29f3-4ab0-bab7-579809935112 1073741824" returned: 0 in 1.428s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:30 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d804a177-29f3-4ab0-bab7-579809935112 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:30 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d804a177-29f3-4ab0-bab7-579809935112 Jul 07 17:29:30 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:30 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a390f173-b0f6-42c7-8e26-6695a1955b39 tempest-AttachVolumeNegativeTest-1635603288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ce56bbd0-60bf-4361-bace-62452585d086" returned: 0 in 1.341s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a390f173-b0f6-42c7-8e26-6695a1955b39 tempest-AttachVolumeNegativeTest-1635603288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ce56bbd0-60bf-4361-bace-62452585d086 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:30 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ce56bbd0-60bf-4361-bace-62452585d086 Jul 07 17:29:30 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:30 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5262e0a3-7b0a-4c1d-b8c7-0057e7937c93 tempest-VolumeDependencyTests-1330000129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.b6e87064-9baf-4d48-8af3-89d505282176" returned: 0 in 1.101s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-5262e0a3-7b0a-4c1d-b8c7-0057e7937c93 tempest-VolumeDependencyTests-1330000129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5883a5da-6f77-4a9d-b538-3b88d42ad276(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:29:31 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e16bbf-1cb9-4026-b7cf-53d69694eba6]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5262e0a3-7b0a-4c1d-b8c7-0057e7937c93 tempest-VolumeDependencyTests-1330000129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:31 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d804a177-29f3-4ab0-bab7-579809935112" returned: 0 in 0.950s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] <== create_volume: return (2457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.461s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef903a1-b7a7-43a3-ae28-443595b0031a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d804a177-29f3-4ab0-bab7-579809935112', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c8fad9-0f1a-4a65-aeb0-56a448151686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:31 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Volume volume-d804a177-29f3-4ab0-bab7-579809935112 (d804a177-29f3-4ab0-bab7-579809935112): created successfully Jul 07 17:29:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c8fad9-0f1a-4a65-aeb0-56a448151686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Flow 'volume_create_manager' (b11931b6-8d10-4b42-b3f3-b2ed1524caa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:31 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-77375fcb-f816-4c85-a011-0a350819e4ff tempest-VolumesListAdminTestJSON-1558901959 None] Created volume successfully. Jul 07 17:29:31 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 Jul 07 17:29:31 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:31 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a390f173-b0f6-42c7-8e26-6695a1955b39 tempest-AttachVolumeNegativeTest-1635603288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ce56bbd0-60bf-4361-bace-62452585d086" returned: 0 in 0.893s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a390f173-b0f6-42c7-8e26-6695a1955b39 tempest-AttachVolumeNegativeTest-1635603288 None] Lock "cinder-quobyte-ce56bbd0-60bf-4361-bace-62452585d086" released by "delete_volume" :: held 2.332s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:31 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-a390f173-b0f6-42c7-8e26-6695a1955b39 tempest-AttachVolumeNegativeTest-1635603288 None] Created reservations ['2424027d-0ba4-4726-b201-ef0aeecfbccb', '987db348-8226-452c-9816-9a002aa7a59c', 'c4f17ca4-ba39-4907-a35f-f224e14d11f2', 'cd3cb128-23da-4a4a-bfb1-cd50343c48d8'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a390f173-b0f6-42c7-8e26-6695a1955b39 tempest-AttachVolumeNegativeTest-1635603288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a390f173-b0f6-42c7-8e26-6695a1955b39 tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a390f173-b0f6-42c7-8e26-6695a1955b39 tempest-AttachVolumeNegativeTest-1635603288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a390f173-b0f6-42c7-8e26-6695a1955b39 tempest-AttachVolumeNegativeTest-1635603288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a390f173-b0f6-42c7-8e26-6695a1955b39 tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a390f173-b0f6-42c7-8e26-6695a1955b39 tempest-AttachVolumeNegativeTest-1635603288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:31 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:29:31 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:32 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5262e0a3-7b0a-4c1d-b8c7-0057e7937c93 tempest-VolumeDependencyTests-1330000129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276" returned: 0 in 1.107s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5262e0a3-7b0a-4c1d-b8c7-0057e7937c93 tempest-VolumeDependencyTests-1330000129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.b6e87064-9baf-4d48-8af3-89d505282176 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:32 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.b6e87064-9baf-4d48-8af3-89d505282176 Jul 07 17:29:32 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Flow 'volume_create_manager' (ee907ad3-4cef-49d4-bcdd-a13a699f96e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0620a66b-f516-4b39-8bd4-2da1eb7d345b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0620a66b-f516-4b39-8bd4-2da1eb7d345b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-345996980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=374c56f1-ce8d-4fc3-8a54-ee589bbb6429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c202f549e174d289d5563f363b6871c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:32Z,use_quota=True,user_id='9223ba80a80a42bca234e69a1ae6395b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272f214f-350d-483c-851b-2287453b4326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272f214f-350d-483c-851b-2287453b4326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be89648f-27f3-4546-aaa3-6fce7d73d83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be89648f-27f3-4546-aaa3-6fce7d73d83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '374c56f1-ce8d-4fc3-8a54-ee589bbb6429', 'volume_name': 'volume-374c56f1-ce8d-4fc3-8a54-ee589bbb6429', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04618158-a606-47d3-b73c-f2b371f74a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04618158-a606-47d3-b73c-f2b371f74a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a81f0d-671f-4583-ae47-76b4417df299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:32 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Volume 374c56f1-ce8d-4fc3-8a54-ee589bbb6429: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-374c56f1-ce8d-4fc3-8a54-ee589bbb6429', 'volume_size': 1} Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-345996980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=374c56f1-ce8d-4fc3-8a54-ee589bbb6429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c202f549e174d289d5563f363b6871c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:32Z,use_quota=True,user_id='9223ba80a80a42bca234e69a1ae6395b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Creating volume 374c56f1-ce8d-4fc3-8a54-ee589bbb6429 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:32 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374c56f1-ce8d-4fc3-8a54-ee589bbb6429 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:32 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374c56f1-ce8d-4fc3-8a54-ee589bbb6429 1073741824 Jul 07 17:29:32 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7c8aec39-a62c-43ee-94e0-f6f00ebd0a5e tempest-AttachVolumeNegativeTest-1635603288 None] Acquiring lock "cinder-cee23b85-1910-4529-8e7e-57f78490dca8-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:32 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7c8aec39-a62c-43ee-94e0-f6f00ebd0a5e tempest-AttachVolumeNegativeTest-1635603288 None] Lock "cinder-cee23b85-1910-4529-8e7e-57f78490dca8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:33 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a390f173-b0f6-42c7-8e26-6695a1955b39 tempest-AttachVolumeNegativeTest-1635603288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.235s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:33 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-a390f173-b0f6-42c7-8e26-6695a1955b39 tempest-AttachVolumeNegativeTest-1635603288 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7c8aec39-a62c-43ee-94e0-f6f00ebd0a5e tempest-AttachVolumeNegativeTest-1635603288 None] Acquiring lock "cinder-quobyte-cee23b85-1910-4529-8e7e-57f78490dca8" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:33 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-a390f173-b0f6-42c7-8e26-6695a1955b39 tempest-AttachVolumeNegativeTest-1635603288 None] Deleted volume successfully. Jul 07 17:29:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7c8aec39-a62c-43ee-94e0-f6f00ebd0a5e tempest-AttachVolumeNegativeTest-1635603288 None] Lock "cinder-quobyte-cee23b85-1910-4529-8e7e-57f78490dca8" acquired by "delete_volume" :: waited 0.036s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a390f173-b0f6-42c7-8e26-6695a1955b39 tempest-AttachVolumeNegativeTest-1635603288 None] Lock "cinder-ce56bbd0-60bf-4361-bace-62452585d086-delete_volume" released by "delete_volume" :: held 3.955s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:33 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaaa5cf-5fc2-4ee3-a77f-559ffbb09f30]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7c8aec39-a62c-43ee-94e0-f6f00ebd0a5e tempest-AttachVolumeNegativeTest-1635603288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cee23b85-1910-4529-8e7e-57f78490dca8 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:33 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cee23b85-1910-4529-8e7e-57f78490dca8 Jul 07 17:29:33 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:33 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5262e0a3-7b0a-4c1d-b8c7-0057e7937c93 tempest-VolumeDependencyTests-1330000129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.b6e87064-9baf-4d48-8af3-89d505282176" returned: 0 in 1.158s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5262e0a3-7b0a-4c1d-b8c7-0057e7937c93 tempest-VolumeDependencyTests-1330000129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.b6e87064-9baf-4d48-8af3-89d505282176 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:33 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.b6e87064-9baf-4d48-8af3-89d505282176 Jul 07 17:29:33 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:33 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374c56f1-ce8d-4fc3-8a54-ee589bbb6429 1073741824" returned: 0 in 1.271s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374c56f1-ce8d-4fc3-8a54-ee589bbb6429 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:34 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374c56f1-ce8d-4fc3-8a54-ee589bbb6429 Jul 07 17:29:34 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:34 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7c8aec39-a62c-43ee-94e0-f6f00ebd0a5e tempest-AttachVolumeNegativeTest-1635603288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cee23b85-1910-4529-8e7e-57f78490dca8" returned: 0 in 1.212s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7c8aec39-a62c-43ee-94e0-f6f00ebd0a5e tempest-AttachVolumeNegativeTest-1635603288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cee23b85-1910-4529-8e7e-57f78490dca8 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:34 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cee23b85-1910-4529-8e7e-57f78490dca8 Jul 07 17:29:34 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:34 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5262e0a3-7b0a-4c1d-b8c7-0057e7937c93 tempest-VolumeDependencyTests-1330000129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276.b6e87064-9baf-4d48-8af3-89d505282176" returned: 0 in 1.160s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5262e0a3-7b0a-4c1d-b8c7-0057e7937c93 tempest-VolumeDependencyTests-1330000129 None] Lock "cinder-quobyte-b6e87064-9baf-4d48-8af3-89d505282176" released by "_delete_snapshot" :: held 4.709s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5262e0a3-7b0a-4c1d-b8c7-0057e7937c93 tempest-VolumeDependencyTests-1330000129 None] Lock "cinder-quobyte-5883a5da-6f77-4a9d-b538-3b88d42ad276" released by "delete_snapshot" :: held 4.760s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:34 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-5262e0a3-7b0a-4c1d-b8c7-0057e7937c93 tempest-VolumeDependencyTests-1330000129 None] Created reservations ['d6e71ea6-b0b3-43e8-8283-4159ba7df086', 'b44a2b08-f4df-46e2-ad4b-e5af3f7f8331', '28c9d404-c58e-4cf2-bccd-2a0125c067a7', '296d2608-f7a4-4959-8fb3-b1c92aa066f7'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:34 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5262e0a3-7b0a-4c1d-b8c7-0057e7937c93 tempest-VolumeDependencyTests-1330000129 None] Delete snapshot completed successfully. Jul 07 17:29:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5262e0a3-7b0a-4c1d-b8c7-0057e7937c93 tempest-VolumeDependencyTests-1330000129 None] Lock "cinder-b6e87064-9baf-4d48-8af3-89d505282176-delete_snapshot" released by "delete_snapshot" :: held 5.032s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:35 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374c56f1-ce8d-4fc3-8a54-ee589bbb6429" returned: 0 in 1.061s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:35 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] <== create_volume: return (2406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.409s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:35 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a81f0d-671f-4583-ae47-76b4417df299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-374c56f1-ce8d-4fc3-8a54-ee589bbb6429', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:35 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced3e0c4-d8ec-4cfc-a65e-926c278d374e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:35 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Volume volume-374c56f1-ce8d-4fc3-8a54-ee589bbb6429 (374c56f1-ce8d-4fc3-8a54-ee589bbb6429): created successfully Jul 07 17:29:35 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced3e0c4-d8ec-4cfc-a65e-926c278d374e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:35 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Flow 'volume_create_manager' (ee907ad3-4cef-49d4-bcdd-a13a699f96e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:35 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7c8aec39-a62c-43ee-94e0-f6f00ebd0a5e tempest-AttachVolumeNegativeTest-1635603288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cee23b85-1910-4529-8e7e-57f78490dca8" returned: 0 in 0.898s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7c8aec39-a62c-43ee-94e0-f6f00ebd0a5e tempest-AttachVolumeNegativeTest-1635603288 None] Lock "cinder-quobyte-cee23b85-1910-4529-8e7e-57f78490dca8" released by "delete_volume" :: held 2.167s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:35 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-430a9b9c-f364-4e12-a9ea-0b2c9718b41e tempest-VolumesListAdminTestJSON-1558901959 None] Created volume successfully. Jul 07 17:29:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a757e09d-3703-46aa-b62f-6c4566b2eda9 tempest-VolumeDependencyTests-1330000129 None] Acquiring lock "cinder-5883a5da-6f77-4a9d-b538-3b88d42ad276-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:35 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-7c8aec39-a62c-43ee-94e0-f6f00ebd0a5e tempest-AttachVolumeNegativeTest-1635603288 None] Created reservations ['6da19df5-4965-4724-a4fc-d24dcee2ccae', '069e39ec-3607-4479-be47-aec4cbd773fc', 'd98e28e2-7fca-4cc8-84d0-75f3ade4084c', 'dc2f6014-bb47-4ad2-815d-85e49b74b2fd'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a757e09d-3703-46aa-b62f-6c4566b2eda9 tempest-VolumeDependencyTests-1330000129 None] Lock "cinder-5883a5da-6f77-4a9d-b538-3b88d42ad276-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a757e09d-3703-46aa-b62f-6c4566b2eda9 tempest-VolumeDependencyTests-1330000129 None] Acquiring lock "cinder-quobyte-5883a5da-6f77-4a9d-b538-3b88d42ad276" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a757e09d-3703-46aa-b62f-6c4566b2eda9 tempest-VolumeDependencyTests-1330000129 None] Lock "cinder-quobyte-5883a5da-6f77-4a9d-b538-3b88d42ad276" acquired by "delete_volume" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:35 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8e56b8-6236-462e-a746-9987a79b2748]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a757e09d-3703-46aa-b62f-6c4566b2eda9 tempest-VolumeDependencyTests-1330000129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7c8aec39-a62c-43ee-94e0-f6f00ebd0a5e tempest-AttachVolumeNegativeTest-1635603288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7c8aec39-a62c-43ee-94e0-f6f00ebd0a5e tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:35 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7c8aec39-a62c-43ee-94e0-f6f00ebd0a5e tempest-AttachVolumeNegativeTest-1635603288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:35 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7c8aec39-a62c-43ee-94e0-f6f00ebd0a5e tempest-AttachVolumeNegativeTest-1635603288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7c8aec39-a62c-43ee-94e0-f6f00ebd0a5e tempest-AttachVolumeNegativeTest-1635603288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7c8aec39-a62c-43ee-94e0-f6f00ebd0a5e tempest-AttachVolumeNegativeTest-1635603288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:35 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 Jul 07 17:29:35 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:35 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:29:35 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:36 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7c8aec39-a62c-43ee-94e0-f6f00ebd0a5e tempest-AttachVolumeNegativeTest-1635603288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.996s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:36 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-7c8aec39-a62c-43ee-94e0-f6f00ebd0a5e tempest-AttachVolumeNegativeTest-1635603288 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:36 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-7c8aec39-a62c-43ee-94e0-f6f00ebd0a5e tempest-AttachVolumeNegativeTest-1635603288 None] Deleted volume successfully. Jul 07 17:29:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7c8aec39-a62c-43ee-94e0-f6f00ebd0a5e tempest-AttachVolumeNegativeTest-1635603288 None] Lock "cinder-cee23b85-1910-4529-8e7e-57f78490dca8-delete_volume" released by "delete_volume" :: held 3.760s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:36 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a757e09d-3703-46aa-b62f-6c4566b2eda9 tempest-VolumeDependencyTests-1330000129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276" returned: 0 in 1.239s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a757e09d-3703-46aa-b62f-6c4566b2eda9 tempest-VolumeDependencyTests-1330000129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:36 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276 Jul 07 17:29:36 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Flow 'volume_create_manager' (bb92b97c-f360-4d85-b2e8-22dddbca634d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1313a1f1-fd60-4715-9f0c-d8c27e5ecf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1313a1f1-fd60-4715-9f0c-d8c27e5ecf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f64d7f6931a24e5e86a0ae4a5569f7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:37Z,use_quota=True,user_id='2df4f3ccc71e43d08bb51d2ff5a2632e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfdf57ea-a081-49ec-9c76-abf1075c6693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfdf57ea-a081-49ec-9c76-abf1075c6693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8315155e-5e61-4057-92b0-09f2a5c213ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8315155e-5e61-4057-92b0-09f2a5c213ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae', 'volume_name': 'volume-6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836ce90c-3fef-4bac-ac1f-804a038b0f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836ce90c-3fef-4bac-ac1f-804a038b0f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6643b8e8-9393-4a01-b303-389e91099241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:37 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Volume 6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae', 'volume_size': 1} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f64d7f6931a24e5e86a0ae4a5569f7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:37Z,use_quota=True,user_id='2df4f3ccc71e43d08bb51d2ff5a2632e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Creating volume 6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:37 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:37 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae 1073741824 Jul 07 17:29:37 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:37 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a757e09d-3703-46aa-b62f-6c4566b2eda9 tempest-VolumeDependencyTests-1330000129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5883a5da-6f77-4a9d-b538-3b88d42ad276" returned: 0 in 0.913s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a757e09d-3703-46aa-b62f-6c4566b2eda9 tempest-VolumeDependencyTests-1330000129 None] Lock "cinder-quobyte-5883a5da-6f77-4a9d-b538-3b88d42ad276" released by "delete_volume" :: held 2.258s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-a757e09d-3703-46aa-b62f-6c4566b2eda9 tempest-VolumeDependencyTests-1330000129 None] Created reservations ['7bddf3fc-a1f5-43ff-afc4-ac4e6a0a6d63', '574ec4b6-4be2-4079-89b2-4dbd1963ff21', 'fb10e18f-1ea6-4d3c-9a84-57e5aba6ab1c', 'beda1555-0bd7-48c8-aaf8-5dcf024f45be'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a757e09d-3703-46aa-b62f-6c4566b2eda9 tempest-VolumeDependencyTests-1330000129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a757e09d-3703-46aa-b62f-6c4566b2eda9 tempest-VolumeDependencyTests-1330000129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a757e09d-3703-46aa-b62f-6c4566b2eda9 tempest-VolumeDependencyTests-1330000129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a757e09d-3703-46aa-b62f-6c4566b2eda9 tempest-VolumeDependencyTests-1330000129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a757e09d-3703-46aa-b62f-6c4566b2eda9 tempest-VolumeDependencyTests-1330000129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a757e09d-3703-46aa-b62f-6c4566b2eda9 tempest-VolumeDependencyTests-1330000129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:37 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:29:37 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:38 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae 1073741824" returned: 0 in 1.199s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:38 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=86,cinder:UPDATE=92,cinder:DELETE=7,cinder:INSERT=22 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:29:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:38 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae Jul 07 17:29:38 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:38 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-33864d35-252e-49b9-8e64-5e626b113032 tempest-VolumeDependencyTests-1330000129 None] Acquiring lock "cinder-4f5d0ec2-67e3-435a-8b73-96b00a01f498-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:39 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-33864d35-252e-49b9-8e64-5e626b113032 tempest-VolumeDependencyTests-1330000129 None] Lock "cinder-4f5d0ec2-67e3-435a-8b73-96b00a01f498-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:39 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-33864d35-252e-49b9-8e64-5e626b113032 tempest-VolumeDependencyTests-1330000129 None] Acquiring lock "cinder-quobyte-4f5d0ec2-67e3-435a-8b73-96b00a01f498" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:39 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-33864d35-252e-49b9-8e64-5e626b113032 tempest-VolumeDependencyTests-1330000129 None] Lock "cinder-quobyte-4f5d0ec2-67e3-435a-8b73-96b00a01f498" acquired by "delete_volume" :: waited 0.039s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:39 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6db476-9fab-4699-8f0c-c29342e12163]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33864d35-252e-49b9-8e64-5e626b113032 tempest-VolumeDependencyTests-1330000129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f5d0ec2-67e3-435a-8b73-96b00a01f498 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:39 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a757e09d-3703-46aa-b62f-6c4566b2eda9 tempest-VolumeDependencyTests-1330000129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.301s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:39 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-a757e09d-3703-46aa-b62f-6c4566b2eda9 tempest-VolumeDependencyTests-1330000129 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:39 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-a757e09d-3703-46aa-b62f-6c4566b2eda9 tempest-VolumeDependencyTests-1330000129 None] Deleted volume successfully. Jul 07 17:29:39 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a757e09d-3703-46aa-b62f-6c4566b2eda9 tempest-VolumeDependencyTests-1330000129 None] Lock "cinder-5883a5da-6f77-4a9d-b538-3b88d42ad276-delete_volume" released by "delete_volume" :: held 3.941s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:39 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f5d0ec2-67e3-435a-8b73-96b00a01f498 Jul 07 17:29:39 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:39 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae" returned: 0 in 1.109s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:39 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] <== create_volume: return (2396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.400s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6643b8e8-9393-4a01-b303-389e91099241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73543b2e-8eaa-49af-9b26-6516fb50d5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:39 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Volume volume-6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae (6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae): created successfully Jul 07 17:29:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73543b2e-8eaa-49af-9b26-6516fb50d5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Flow 'volume_create_manager' (bb92b97c-f360-4d85-b2e8-22dddbca634d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:39 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-aa146c52-17b1-4fe1-86ca-c7699e356712 tempest-VolumesListAdminTestJSON-1606100124 None] Created volume successfully. Jul 07 17:29:40 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33864d35-252e-49b9-8e64-5e626b113032 tempest-VolumeDependencyTests-1330000129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f5d0ec2-67e3-435a-8b73-96b00a01f498" returned: 0 in 1.193s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33864d35-252e-49b9-8e64-5e626b113032 tempest-VolumeDependencyTests-1330000129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f5d0ec2-67e3-435a-8b73-96b00a01f498 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:40 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f5d0ec2-67e3-435a-8b73-96b00a01f498 Jul 07 17:29:40 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:40 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b57879ec-8feb-4aea-ad90-6dad63272d16 tempest-VolumesListAdminTestJSON-1606100124 None] Acquiring lock "cinder-6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:40 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b57879ec-8feb-4aea-ad90-6dad63272d16 tempest-VolumesListAdminTestJSON-1606100124 None] Lock "cinder-6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:40 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b57879ec-8feb-4aea-ad90-6dad63272d16 tempest-VolumesListAdminTestJSON-1606100124 None] Acquiring lock "cinder-quobyte-6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:40 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b57879ec-8feb-4aea-ad90-6dad63272d16 tempest-VolumesListAdminTestJSON-1606100124 None] Lock "cinder-quobyte-6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae" acquired by "delete_volume" :: waited 0.027s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:40 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb627c3-cfa0-448f-ba5c-9a3dd7fc5e64]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b57879ec-8feb-4aea-ad90-6dad63272d16 tempest-VolumesListAdminTestJSON-1606100124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:40 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d65df680-3968-4fe8-9331-d3f20bdab2bd tempest-VolumesListAdminTestJSON-1558901959 None] Acquiring lock "cinder-374c56f1-ce8d-4fc3-8a54-ee589bbb6429-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:40 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d65df680-3968-4fe8-9331-d3f20bdab2bd tempest-VolumesListAdminTestJSON-1558901959 None] Lock "cinder-374c56f1-ce8d-4fc3-8a54-ee589bbb6429-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:40 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d65df680-3968-4fe8-9331-d3f20bdab2bd tempest-VolumesListAdminTestJSON-1558901959 None] Acquiring lock "cinder-quobyte-374c56f1-ce8d-4fc3-8a54-ee589bbb6429" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:40 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d65df680-3968-4fe8-9331-d3f20bdab2bd tempest-VolumesListAdminTestJSON-1558901959 None] Lock "cinder-quobyte-374c56f1-ce8d-4fc3-8a54-ee589bbb6429" acquired by "delete_volume" :: waited 0.022s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:40 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99b5bb9-2575-43d6-9dbd-2f5cbe6ddd98]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d65df680-3968-4fe8-9331-d3f20bdab2bd tempest-VolumesListAdminTestJSON-1558901959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374c56f1-ce8d-4fc3-8a54-ee589bbb6429 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:40 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae Jul 07 17:29:40 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:41 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374c56f1-ce8d-4fc3-8a54-ee589bbb6429 Jul 07 17:29:41 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:41 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33864d35-252e-49b9-8e64-5e626b113032 tempest-VolumeDependencyTests-1330000129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f5d0ec2-67e3-435a-8b73-96b00a01f498" returned: 0 in 1.557s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:41 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-33864d35-252e-49b9-8e64-5e626b113032 tempest-VolumeDependencyTests-1330000129 None] Lock "cinder-quobyte-4f5d0ec2-67e3-435a-8b73-96b00a01f498" released by "delete_volume" :: held 2.839s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:42 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b57879ec-8feb-4aea-ad90-6dad63272d16 tempest-VolumesListAdminTestJSON-1606100124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae" returned: 0 in 1.331s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b57879ec-8feb-4aea-ad90-6dad63272d16 tempest-VolumesListAdminTestJSON-1606100124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:42 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae Jul 07 17:29:42 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:42 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-33864d35-252e-49b9-8e64-5e626b113032 tempest-VolumeDependencyTests-1330000129 None] Created reservations ['38193171-af06-4ce4-aea5-e88c6c33024c', 'eb921b72-f5e9-4920-9f17-255438ac5780', '42870a55-bcdf-4471-97ad-f94b46fd1976', '1b6e2ad0-d9b7-4b26-b690-a613f25ac86b'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-33864d35-252e-49b9-8e64-5e626b113032 tempest-VolumeDependencyTests-1330000129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-33864d35-252e-49b9-8e64-5e626b113032 tempest-VolumeDependencyTests-1330000129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-33864d35-252e-49b9-8e64-5e626b113032 tempest-VolumeDependencyTests-1330000129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-33864d35-252e-49b9-8e64-5e626b113032 tempest-VolumeDependencyTests-1330000129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-33864d35-252e-49b9-8e64-5e626b113032 tempest-VolumeDependencyTests-1330000129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33864d35-252e-49b9-8e64-5e626b113032 tempest-VolumeDependencyTests-1330000129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:42 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:29:42 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:42 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d65df680-3968-4fe8-9331-d3f20bdab2bd tempest-VolumesListAdminTestJSON-1558901959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374c56f1-ce8d-4fc3-8a54-ee589bbb6429" returned: 0 in 1.584s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d65df680-3968-4fe8-9331-d3f20bdab2bd tempest-VolumesListAdminTestJSON-1558901959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374c56f1-ce8d-4fc3-8a54-ee589bbb6429 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:42 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374c56f1-ce8d-4fc3-8a54-ee589bbb6429 Jul 07 17:29:42 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:43 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33864d35-252e-49b9-8e64-5e626b113032 tempest-VolumeDependencyTests-1330000129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.196s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:43 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-33864d35-252e-49b9-8e64-5e626b113032 tempest-VolumeDependencyTests-1330000129 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:43 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-33864d35-252e-49b9-8e64-5e626b113032 tempest-VolumeDependencyTests-1330000129 None] Deleted volume successfully. Jul 07 17:29:43 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-33864d35-252e-49b9-8e64-5e626b113032 tempest-VolumeDependencyTests-1330000129 None] Lock "cinder-4f5d0ec2-67e3-435a-8b73-96b00a01f498-delete_volume" released by "delete_volume" :: held 4.582s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:43 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b57879ec-8feb-4aea-ad90-6dad63272d16 tempest-VolumesListAdminTestJSON-1606100124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae" returned: 0 in 1.571s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:43 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d65df680-3968-4fe8-9331-d3f20bdab2bd tempest-VolumesListAdminTestJSON-1558901959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-374c56f1-ce8d-4fc3-8a54-ee589bbb6429" returned: 0 in 1.116s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:43 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b57879ec-8feb-4aea-ad90-6dad63272d16 tempest-VolumesListAdminTestJSON-1606100124 None] Lock "cinder-quobyte-6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae" released by "delete_volume" :: held 3.001s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:43 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d65df680-3968-4fe8-9331-d3f20bdab2bd tempest-VolumesListAdminTestJSON-1558901959 None] Lock "cinder-quobyte-374c56f1-ce8d-4fc3-8a54-ee589bbb6429" released by "delete_volume" :: held 2.796s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:43 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-b57879ec-8feb-4aea-ad90-6dad63272d16 tempest-VolumesListAdminTestJSON-1606100124 None] Created reservations ['ef8e4bfd-6623-440b-a497-c2280e8dac7f', '2faebf8a-2e06-4a59-9131-f0ab57e6b85e', '8c971abd-55ea-46a6-b980-3c40874350e3', 'd21c0993-9688-4b44-914c-0c937b5b2e40'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:43 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-d65df680-3968-4fe8-9331-d3f20bdab2bd tempest-VolumesListAdminTestJSON-1558901959 None] Created reservations ['a832bf37-7181-47cc-a065-7bf888d42f6d', '1c4e04e1-39c4-4676-8442-b50549c5e101', '44a8f519-b66d-470e-a47c-d0714d979e30', '45070883-6b97-499b-ac86-a0b797fa2e33'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b57879ec-8feb-4aea-ad90-6dad63272d16 tempest-VolumesListAdminTestJSON-1606100124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b57879ec-8feb-4aea-ad90-6dad63272d16 tempest-VolumesListAdminTestJSON-1606100124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b57879ec-8feb-4aea-ad90-6dad63272d16 tempest-VolumesListAdminTestJSON-1606100124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b57879ec-8feb-4aea-ad90-6dad63272d16 tempest-VolumesListAdminTestJSON-1606100124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b57879ec-8feb-4aea-ad90-6dad63272d16 tempest-VolumesListAdminTestJSON-1606100124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b57879ec-8feb-4aea-ad90-6dad63272d16 tempest-VolumesListAdminTestJSON-1606100124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:44 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:29:44 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d65df680-3968-4fe8-9331-d3f20bdab2bd tempest-VolumesListAdminTestJSON-1558901959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d65df680-3968-4fe8-9331-d3f20bdab2bd tempest-VolumesListAdminTestJSON-1558901959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d65df680-3968-4fe8-9331-d3f20bdab2bd tempest-VolumesListAdminTestJSON-1558901959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d65df680-3968-4fe8-9331-d3f20bdab2bd tempest-VolumesListAdminTestJSON-1558901959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d65df680-3968-4fe8-9331-d3f20bdab2bd tempest-VolumesListAdminTestJSON-1558901959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d65df680-3968-4fe8-9331-d3f20bdab2bd tempest-VolumesListAdminTestJSON-1558901959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:44 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:29:44 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:44 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7d4ca353-8b48-4213-a9ac-043e5821e90a tempest-VolumesListAdminTestJSON-1558901959 None] Acquiring lock "cinder-d804a177-29f3-4ab0-bab7-579809935112-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:44 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7d4ca353-8b48-4213-a9ac-043e5821e90a tempest-VolumesListAdminTestJSON-1558901959 None] Lock "cinder-d804a177-29f3-4ab0-bab7-579809935112-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:44 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7d4ca353-8b48-4213-a9ac-043e5821e90a tempest-VolumesListAdminTestJSON-1558901959 None] Acquiring lock "cinder-quobyte-d804a177-29f3-4ab0-bab7-579809935112" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:44 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7d4ca353-8b48-4213-a9ac-043e5821e90a tempest-VolumesListAdminTestJSON-1558901959 None] Lock "cinder-quobyte-d804a177-29f3-4ab0-bab7-579809935112" acquired by "delete_volume" :: waited 0.047s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:44 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf15cc35-1823-43fe-9672-b77a0141b343]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7d4ca353-8b48-4213-a9ac-043e5821e90a tempest-VolumesListAdminTestJSON-1558901959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d804a177-29f3-4ab0-bab7-579809935112 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:45 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d804a177-29f3-4ab0-bab7-579809935112 Jul 07 17:29:45 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:45 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d65df680-3968-4fe8-9331-d3f20bdab2bd tempest-VolumesListAdminTestJSON-1558901959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.606s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:45 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-d65df680-3968-4fe8-9331-d3f20bdab2bd tempest-VolumesListAdminTestJSON-1558901959 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:45 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-d65df680-3968-4fe8-9331-d3f20bdab2bd tempest-VolumesListAdminTestJSON-1558901959 None] Deleted volume successfully. Jul 07 17:29:45 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d65df680-3968-4fe8-9331-d3f20bdab2bd tempest-VolumesListAdminTestJSON-1558901959 None] Lock "cinder-374c56f1-ce8d-4fc3-8a54-ee589bbb6429-delete_volume" released by "delete_volume" :: held 5.022s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:45 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b57879ec-8feb-4aea-ad90-6dad63272d16 tempest-VolumesListAdminTestJSON-1606100124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.897s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:45 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-b57879ec-8feb-4aea-ad90-6dad63272d16 tempest-VolumesListAdminTestJSON-1606100124 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:45 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b57879ec-8feb-4aea-ad90-6dad63272d16 tempest-VolumesListAdminTestJSON-1606100124 None] Deleted volume successfully. Jul 07 17:29:46 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b57879ec-8feb-4aea-ad90-6dad63272d16 tempest-VolumesListAdminTestJSON-1606100124 None] Lock "cinder-6ffbd34e-0cd4-4811-bd9c-85ce4fc63dae-delete_volume" released by "delete_volume" :: held 5.511s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:46 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7d4ca353-8b48-4213-a9ac-043e5821e90a tempest-VolumesListAdminTestJSON-1558901959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d804a177-29f3-4ab0-bab7-579809935112" returned: 0 in 1.243s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7d4ca353-8b48-4213-a9ac-043e5821e90a tempest-VolumesListAdminTestJSON-1558901959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d804a177-29f3-4ab0-bab7-579809935112 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:46 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d804a177-29f3-4ab0-bab7-579809935112 Jul 07 17:29:46 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:47 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7d4ca353-8b48-4213-a9ac-043e5821e90a tempest-VolumesListAdminTestJSON-1558901959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d804a177-29f3-4ab0-bab7-579809935112" returned: 0 in 1.020s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:47 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7d4ca353-8b48-4213-a9ac-043e5821e90a tempest-VolumesListAdminTestJSON-1558901959 None] Lock "cinder-quobyte-d804a177-29f3-4ab0-bab7-579809935112" released by "delete_volume" :: held 2.377s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:47 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-7d4ca353-8b48-4213-a9ac-043e5821e90a tempest-VolumesListAdminTestJSON-1558901959 None] Created reservations ['955b0d80-49ca-42cf-bfff-741c3cb5d4ac', 'b26b30e6-6fef-405a-b2b1-b86a23539305', 'ced5aa26-8a91-4b9c-b4b3-f1a11d69de95', 'f90ac84b-f4db-4ecc-8f62-bf0b473f6474'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7d4ca353-8b48-4213-a9ac-043e5821e90a tempest-VolumesListAdminTestJSON-1558901959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7d4ca353-8b48-4213-a9ac-043e5821e90a tempest-VolumesListAdminTestJSON-1558901959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7d4ca353-8b48-4213-a9ac-043e5821e90a tempest-VolumesListAdminTestJSON-1558901959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7d4ca353-8b48-4213-a9ac-043e5821e90a tempest-VolumesListAdminTestJSON-1558901959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7d4ca353-8b48-4213-a9ac-043e5821e90a tempest-VolumesListAdminTestJSON-1558901959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7d4ca353-8b48-4213-a9ac-043e5821e90a tempest-VolumesListAdminTestJSON-1558901959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:47 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:29:47 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:48 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7d4ca353-8b48-4213-a9ac-043e5821e90a tempest-VolumesListAdminTestJSON-1558901959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.040s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:48 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-7d4ca353-8b48-4213-a9ac-043e5821e90a tempest-VolumesListAdminTestJSON-1558901959 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:48 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-7d4ca353-8b48-4213-a9ac-043e5821e90a tempest-VolumesListAdminTestJSON-1558901959 None] Deleted volume successfully. Jul 07 17:29:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ac8ffdbe-95cf-4285-9115-86d52a3e74d8 tempest-VolumesListAdminTestJSON-1558901959 None] Acquiring lock "cinder-5eb11890-883e-4e3b-a745-705a34470564-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7d4ca353-8b48-4213-a9ac-043e5821e90a tempest-VolumesListAdminTestJSON-1558901959 None] Lock "cinder-d804a177-29f3-4ab0-bab7-579809935112-delete_volume" released by "delete_volume" :: held 3.899s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ac8ffdbe-95cf-4285-9115-86d52a3e74d8 tempest-VolumesListAdminTestJSON-1558901959 None] Lock "cinder-5eb11890-883e-4e3b-a745-705a34470564-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ac8ffdbe-95cf-4285-9115-86d52a3e74d8 tempest-VolumesListAdminTestJSON-1558901959 None] Acquiring lock "cinder-quobyte-5eb11890-883e-4e3b-a745-705a34470564" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ac8ffdbe-95cf-4285-9115-86d52a3e74d8 tempest-VolumesListAdminTestJSON-1558901959 None] Lock "cinder-quobyte-5eb11890-883e-4e3b-a745-705a34470564" acquired by "delete_volume" :: waited 0.028s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:48 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[e940adc3-7c19-496f-b8a8-b7ed7c4f5582]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ac8ffdbe-95cf-4285-9115-86d52a3e74d8 tempest-VolumesListAdminTestJSON-1558901959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5eb11890-883e-4e3b-a745-705a34470564 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:48 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5eb11890-883e-4e3b-a745-705a34470564 Jul 07 17:29:48 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:49 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Flow 'volume_create_manager' (f32ed634-b450-4e34-8ae2-998044a1d107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de0d604-3860-475d-b0c5-89dec9ec739d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:50 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ac8ffdbe-95cf-4285-9115-86d52a3e74d8 tempest-VolumesListAdminTestJSON-1558901959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5eb11890-883e-4e3b-a745-705a34470564" returned: 0 in 1.223s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ac8ffdbe-95cf-4285-9115-86d52a3e74d8 tempest-VolumesListAdminTestJSON-1558901959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5eb11890-883e-4e3b-a745-705a34470564 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de0d604-3860-475d-b0c5-89dec9ec739d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1723931424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d77700b-812e-426a-b897-259fa5a390be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50f5ba2dfec94959b87cda62243a11ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:50Z,use_quota=True,user_id='6374b2d7e3914166881008b8ad3ef947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe6ec1f-1062-42d3-b0de-690a26ea2dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:50 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5eb11890-883e-4e3b-a745-705a34470564 Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe6ec1f-1062-42d3-b0de-690a26ea2dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:50 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf67da5-9d61-4fcf-bcc4-e7cdb116ea8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf67da5-9d61-4fcf-bcc4-e7cdb116ea8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d77700b-812e-426a-b897-259fa5a390be', 'volume_name': 'volume-3d77700b-812e-426a-b897-259fa5a390be', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6c9bd1-7bec-4c16-8fc8-fc5ef07fd8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6c9bd1-7bec-4c16-8fc8-fc5ef07fd8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d913e3-58d9-4d02-9d62-2d182ffaffe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:50 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Volume 3d77700b-812e-426a-b897-259fa5a390be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d77700b-812e-426a-b897-259fa5a390be', 'volume_size': 1} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1723931424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d77700b-812e-426a-b897-259fa5a390be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50f5ba2dfec94959b87cda62243a11ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:50Z,use_quota=True,user_id='6374b2d7e3914166881008b8ad3ef947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Creating volume 3d77700b-812e-426a-b897-259fa5a390be {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:50 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d77700b-812e-426a-b897-259fa5a390be 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:50 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d77700b-812e-426a-b897-259fa5a390be 1073741824 Jul 07 17:29:50 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Flow 'volume_create_manager' (ef498dfc-7bc9-4664-9b73-f3aabb5ee149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a98516-a006-4337-8bb8-47203f65b959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a98516-a006-4337-8bb8-47203f65b959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1926160121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542cdf6e-cb82-4966-b890-9a926ad18655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e66f968340f2402a8faf9eceaec28b6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:50Z,use_quota=True,user_id='38b7861494834977b1cfbae327e10a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae503b9-7964-4ebd-9d5d-985443173163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae503b9-7964-4ebd-9d5d-985443173163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2e9c40-483a-4f1b-8a20-cee7bd6b65a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2e9c40-483a-4f1b-8a20-cee7bd6b65a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '542cdf6e-cb82-4966-b890-9a926ad18655', 'volume_name': 'volume-542cdf6e-cb82-4966-b890-9a926ad18655', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4081b9b1-b98b-410c-8b67-4e4751e6836a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4081b9b1-b98b-410c-8b67-4e4751e6836a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f23737-5253-482a-9711-516da5627ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:50 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Volume 542cdf6e-cb82-4966-b890-9a926ad18655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-542cdf6e-cb82-4966-b890-9a926ad18655', 'volume_size': 1} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:50 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ac8ffdbe-95cf-4285-9115-86d52a3e74d8 tempest-VolumesListAdminTestJSON-1558901959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5eb11890-883e-4e3b-a745-705a34470564" returned: 0 in 0.874s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ac8ffdbe-95cf-4285-9115-86d52a3e74d8 tempest-VolumesListAdminTestJSON-1558901959 None] Lock "cinder-quobyte-5eb11890-883e-4e3b-a745-705a34470564" released by "delete_volume" :: held 2.169s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:50 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-ac8ffdbe-95cf-4285-9115-86d52a3e74d8 tempest-VolumesListAdminTestJSON-1558901959 None] Created reservations ['a2caa068-171b-436f-b554-7e772d232615', '455b9630-032d-4113-9364-4e99dd4d319c', '0562e01c-81a7-47e9-9838-4862b0022e41', '9e86c43b-6169-48b1-a495-f10339d16483'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ac8ffdbe-95cf-4285-9115-86d52a3e74d8 tempest-VolumesListAdminTestJSON-1558901959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ac8ffdbe-95cf-4285-9115-86d52a3e74d8 tempest-VolumesListAdminTestJSON-1558901959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ac8ffdbe-95cf-4285-9115-86d52a3e74d8 tempest-VolumesListAdminTestJSON-1558901959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ac8ffdbe-95cf-4285-9115-86d52a3e74d8 tempest-VolumesListAdminTestJSON-1558901959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ac8ffdbe-95cf-4285-9115-86d52a3e74d8 tempest-VolumesListAdminTestJSON-1558901959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ac8ffdbe-95cf-4285-9115-86d52a3e74d8 tempest-VolumesListAdminTestJSON-1558901959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:51 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:29:51 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:51 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d77700b-812e-426a-b897-259fa5a390be 1073741824" returned: 0 in 1.136s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d77700b-812e-426a-b897-259fa5a390be {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:51 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d77700b-812e-426a-b897-259fa5a390be Jul 07 17:29:51 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:51 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ac8ffdbe-95cf-4285-9115-86d52a3e74d8 tempest-VolumesListAdminTestJSON-1558901959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.760s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:51 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-ac8ffdbe-95cf-4285-9115-86d52a3e74d8 tempest-VolumesListAdminTestJSON-1558901959 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:51 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-ac8ffdbe-95cf-4285-9115-86d52a3e74d8 tempest-VolumesListAdminTestJSON-1558901959 None] Deleted volume successfully. Jul 07 17:29:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ac8ffdbe-95cf-4285-9115-86d52a3e74d8 tempest-VolumesListAdminTestJSON-1558901959 None] Lock "cinder-5eb11890-883e-4e3b-a745-705a34470564-delete_volume" released by "delete_volume" :: held 3.235s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:52 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d77700b-812e-426a-b897-259fa5a390be" returned: 0 in 0.907s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:52 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] <== create_volume: return (2104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.106s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.712s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:52 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1926160121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542cdf6e-cb82-4966-b890-9a926ad18655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e66f968340f2402a8faf9eceaec28b6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:50Z,use_quota=True,user_id='38b7861494834977b1cfbae327e10a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:29:52 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Creating volume 542cdf6e-cb82-4966-b890-9a926ad18655 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:29:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:52 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:52 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:52 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:29:52 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:29:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:52 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655 1073741824 Jul 07 17:29:52 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d913e3-58d9-4d02-9d62-2d182ffaffe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d77700b-812e-426a-b897-259fa5a390be', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d9a651-85d6-400e-9a5a-80a9ee0658b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:52 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Volume volume-3d77700b-812e-426a-b897-259fa5a390be (3d77700b-812e-426a-b897-259fa5a390be): created successfully Jul 07 17:29:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d9a651-85d6-400e-9a5a-80a9ee0658b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Flow 'volume_create_manager' (f32ed634-b450-4e34-8ae2-998044a1d107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:52 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-25e7f267-c71d-4115-886c-27dd9e89238f tempest-ProjectReaderTests-1226616585 None] Created volume successfully. Jul 07 17:29:53 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655 1073741824" returned: 0 in 1.275s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:53 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655 Jul 07 17:29:53 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-26d919e5-323f-4c51-8a09-9c4a99701200 tempest-ProjectReaderTests-1226616585 None] Acquiring lock "cinder-3d77700b-812e-426a-b897-259fa5a390be-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-26d919e5-323f-4c51-8a09-9c4a99701200 tempest-ProjectReaderTests-1226616585 None] Lock "cinder-3d77700b-812e-426a-b897-259fa5a390be-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-26d919e5-323f-4c51-8a09-9c4a99701200 tempest-ProjectReaderTests-1226616585 None] Acquiring lock "cinder-quobyte-3d77700b-812e-426a-b897-259fa5a390be" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:29:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-26d919e5-323f-4c51-8a09-9c4a99701200 tempest-ProjectReaderTests-1226616585 None] Lock "cinder-quobyte-3d77700b-812e-426a-b897-259fa5a390be" acquired by "delete_volume" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:29:53 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[6616d698-ecd1-4be2-9364-48a1e590e141]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-26d919e5-323f-4c51-8a09-9c4a99701200 tempest-ProjectReaderTests-1226616585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d77700b-812e-426a-b897-259fa5a390be {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:54 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d77700b-812e-426a-b897-259fa5a390be Jul 07 17:29:54 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:54 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655" returned: 0 in 1.045s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:54 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] <== create_volume: return (2400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:29:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.405s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f23737-5253-482a-9711-516da5627ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-542cdf6e-cb82-4966-b890-9a926ad18655', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ea37f8-ac64-4266-a006-75d24e80c0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:54 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Volume volume-542cdf6e-cb82-4966-b890-9a926ad18655 (542cdf6e-cb82-4966-b890-9a926ad18655): created successfully Jul 07 17:29:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ea37f8-ac64-4266-a006-75d24e80c0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Flow 'volume_create_manager' (ef498dfc-7bc9-4664-9b73-f3aabb5ee149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:54 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-9f6e8865-3893-4038-9047-b23655217d7f req-a9fdd1ea-ac3b-4471-a24a-c3207141fd74 tempest-VolumesSnapshotsTestJSON-1445835600 None] Created volume successfully. Jul 07 17:29:55 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-26d919e5-323f-4c51-8a09-9c4a99701200 tempest-ProjectReaderTests-1226616585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d77700b-812e-426a-b897-259fa5a390be" returned: 0 in 1.172s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-26d919e5-323f-4c51-8a09-9c4a99701200 tempest-ProjectReaderTests-1226616585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d77700b-812e-426a-b897-259fa5a390be {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:55 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d77700b-812e-426a-b897-259fa5a390be Jul 07 17:29:55 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-ea0fe510-26e4-4bf4-a523-983809c6b77d req-36f10ce2-912d-48d0-ac7f-e7af772b92b6 tempest-VolumesSnapshotsTestJSON-1445835600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-ea0fe510-26e4-4bf4-a523-983809c6b77d req-36f10ce2-912d-48d0-ac7f-e7af772b92b6 tempest-VolumesSnapshotsTestJSON-1445835600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:55 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [req-ea0fe510-26e4-4bf4-a523-983809c6b77d req-36f10ce2-912d-48d0-ac7f-e7af772b92b6 tempest-VolumesSnapshotsTestJSON-1445835600 None] Creating offline snapshot aafc23e4-c61a-4194-9cda-bbc0d33be6cb of volume 542cdf6e-cb82-4966-b890-9a926ad18655 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:29:55 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[7024883a-19fc-4898-9ce8-0dedda610c5e]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:29:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-ea0fe510-26e4-4bf4-a523-983809c6b77d req-36f10ce2-912d-48d0-ac7f-e7af772b92b6 tempest-VolumesSnapshotsTestJSON-1445835600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:56 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655 Jul 07 17:29:56 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:56 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-26d919e5-323f-4c51-8a09-9c4a99701200 tempest-ProjectReaderTests-1226616585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d77700b-812e-426a-b897-259fa5a390be" returned: 0 in 1.045s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-26d919e5-323f-4c51-8a09-9c4a99701200 tempest-ProjectReaderTests-1226616585 None] Lock "cinder-quobyte-3d77700b-812e-426a-b897-259fa5a390be" released by "delete_volume" :: held 2.312s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:56 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-26d919e5-323f-4c51-8a09-9c4a99701200 tempest-ProjectReaderTests-1226616585 None] Created reservations ['5dfe95c6-6576-4882-8693-14c09db2bc4b', '3fb7e982-d0e4-4225-a4b7-729b2b82698d', '2f7694c7-defc-4407-8ba3-cf10045d2d2d', 'af9acb0b-dae4-4629-a8e6-c7f0df7fd61f'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:29:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-26d919e5-323f-4c51-8a09-9c4a99701200 tempest-ProjectReaderTests-1226616585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-26d919e5-323f-4c51-8a09-9c4a99701200 tempest-ProjectReaderTests-1226616585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-26d919e5-323f-4c51-8a09-9c4a99701200 tempest-ProjectReaderTests-1226616585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-26d919e5-323f-4c51-8a09-9c4a99701200 tempest-ProjectReaderTests-1226616585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-26d919e5-323f-4c51-8a09-9c4a99701200 tempest-ProjectReaderTests-1226616585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-26d919e5-323f-4c51-8a09-9c4a99701200 tempest-ProjectReaderTests-1226616585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:56 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:29:56 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:29:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:29:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:29:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:29:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:29:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:56 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:29:56 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:57 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-26d919e5-323f-4c51-8a09-9c4a99701200 tempest-ProjectReaderTests-1226616585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.284s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-26d919e5-323f-4c51-8a09-9c4a99701200 tempest-ProjectReaderTests-1226616585 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:57 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:57 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-26d919e5-323f-4c51-8a09-9c4a99701200 tempest-ProjectReaderTests-1226616585 None] Deleted volume successfully. Jul 07 17:29:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-ea0fe510-26e4-4bf4-a523-983809c6b77d req-36f10ce2-912d-48d0-ac7f-e7af772b92b6 tempest-VolumesSnapshotsTestJSON-1445835600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655" returned: 0 in 1.844s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-ea0fe510-26e4-4bf4-a523-983809c6b77d req-36f10ce2-912d-48d0-ac7f-e7af772b92b6 tempest-VolumesSnapshotsTestJSON-1445835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.aafc23e4-c61a-4194-9cda-bbc0d33be6cb 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:57 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.aafc23e4-c61a-4194-9cda-bbc0d33be6cb 1G Jul 07 17:29:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-26d919e5-323f-4c51-8a09-9c4a99701200 tempest-ProjectReaderTests-1226616585 None] Lock "cinder-3d77700b-812e-426a-b897-259fa5a390be-delete_volume" released by "delete_volume" :: held 4.036s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:29:57 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:29:57 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:29:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Flow 'volume_create_manager' (c235d144-e90c-4c7c-bc17-b4e2a7617824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:29:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e75d67-ab69-4ea2-8dae-cb5b37c2d1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e75d67-ab69-4ea2-8dae-cb5b37c2d1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-34500265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc517ec7-15ef-48ae-9578-6290334b17df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50f5ba2dfec94959b87cda62243a11ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:58Z,use_quota=True,user_id='6374b2d7e3914166881008b8ad3ef947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d164fec9-b19c-496e-8892-6cc03a82c29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d164fec9-b19c-496e-8892-6cc03a82c29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d03a8a5-31dd-4b59-9a4d-d1176e629664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d03a8a5-31dd-4b59-9a4d-d1176e629664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc517ec7-15ef-48ae-9578-6290334b17df', 'volume_name': 'volume-cc517ec7-15ef-48ae-9578-6290334b17df', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f252585-623f-4fa0-9d02-a3fb9a944bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f252585-623f-4fa0-9d02-a3fb9a944bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:29:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f285880a-fccc-4f27-9220-a1736aeb3107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:29:58 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Volume cc517ec7-15ef-48ae-9578-6290334b17df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc517ec7-15ef-48ae-9578-6290334b17df', 'volume_size': 1} Jul 07 17:29:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:29:58 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.618s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:58 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:29:58 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:29:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:29:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:29:58 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Jul 07 17:29:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-ea0fe510-26e4-4bf4-a523-983809c6b77d req-36f10ce2-912d-48d0-ac7f-e7af772b92b6 tempest-VolumesSnapshotsTestJSON-1445835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.aafc23e4-c61a-4194-9cda-bbc0d33be6cb 1G" returned: 0 in 1.154s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:29:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-ea0fe510-26e4-4bf4-a523-983809c6b77d req-36f10ce2-912d-48d0-ac7f-e7af772b92b6 tempest-VolumesSnapshotsTestJSON-1445835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-542cdf6e-cb82-4966-b890-9a926ad18655 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.aafc23e4-c61a-4194-9cda-bbc0d33be6cb {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:29:58 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-542cdf6e-cb82-4966-b890-9a926ad18655 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.aafc23e4-c61a-4194-9cda-bbc0d33be6cb Jul 07 17:29:58 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:00 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-ea0fe510-26e4-4bf4-a523-983809c6b77d req-36f10ce2-912d-48d0-ac7f-e7af772b92b6 tempest-VolumesSnapshotsTestJSON-1445835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-542cdf6e-cb82-4966-b890-9a926ad18655 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.aafc23e4-c61a-4194-9cda-bbc0d33be6cb" returned: 0 in 1.090s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:00 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [req-ea0fe510-26e4-4bf4-a523-983809c6b77d req-36f10ce2-912d-48d0-ac7f-e7af772b92b6 tempest-VolumesSnapshotsTestJSON-1445835600 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.aafc23e4-c61a-4194-9cda-bbc0d33be6cb is being set with open permissions: ugo+rw Jul 07 17:30:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-ea0fe510-26e4-4bf4-a523-983809c6b77d req-36f10ce2-912d-48d0-ac7f-e7af772b92b6 tempest-VolumesSnapshotsTestJSON-1445835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.aafc23e4-c61a-4194-9cda-bbc0d33be6cb {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:00 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.aafc23e4-c61a-4194-9cda-bbc0d33be6cb Jul 07 17:30:00 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:00 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-ea0fe510-26e4-4bf4-a523-983809c6b77d req-36f10ce2-912d-48d0-ac7f-e7af772b92b6 tempest-VolumesSnapshotsTestJSON-1445835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.aafc23e4-c61a-4194-9cda-bbc0d33be6cb" returned: 0 in 0.882s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-ea0fe510-26e4-4bf4-a523-983809c6b77d req-36f10ce2-912d-48d0-ac7f-e7af772b92b6 tempest-VolumesSnapshotsTestJSON-1445835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:01 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.info Jul 07 17:30:01 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:01 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-ea0fe510-26e4-4bf4-a523-983809c6b77d req-36f10ce2-912d-48d0-ac7f-e7af772b92b6 tempest-VolumesSnapshotsTestJSON-1445835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.info" returned: 0 in 0.825s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:01 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [req-ea0fe510-26e4-4bf4-a523-983809c6b77d req-36f10ce2-912d-48d0-ac7f-e7af772b92b6 tempest-VolumesSnapshotsTestJSON-1445835600 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.info is being set with open permissions: ugo+rw Jul 07 17:30:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-ea0fe510-26e4-4bf4-a523-983809c6b77d req-36f10ce2-912d-48d0-ac7f-e7af772b92b6 tempest-VolumesSnapshotsTestJSON-1445835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:01 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.info Jul 07 17:30:01 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:02 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-ea0fe510-26e4-4bf4-a523-983809c6b77d req-36f10ce2-912d-48d0-ac7f-e7af772b92b6 tempest-VolumesSnapshotsTestJSON-1445835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.info" returned: 0 in 0.946s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-ea0fe510-26e4-4bf4-a523-983809c6b77d req-36f10ce2-912d-48d0-ac7f-e7af772b92b6 tempest-VolumesSnapshotsTestJSON-1445835600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.931s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.718s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:02 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-34500265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc517ec7-15ef-48ae-9578-6290334b17df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50f5ba2dfec94959b87cda62243a11ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:29:58Z,use_quota=True,user_id='6374b2d7e3914166881008b8ad3ef947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:02 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Creating volume cc517ec7-15ef-48ae-9578-6290334b17df {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:02 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:02 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:02 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:02 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:30:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cc517ec7-15ef-48ae-9578-6290334b17df 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:02 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cc517ec7-15ef-48ae-9578-6290334b17df 1073741824 Jul 07 17:30:02 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:02 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-ea0fe510-26e4-4bf4-a523-983809c6b77d req-36f10ce2-912d-48d0-ac7f-e7af772b92b6 tempest-VolumesSnapshotsTestJSON-1445835600 None] Create snapshot completed successfully Jul 07 17:30:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-6c8f3080-de3d-4275-98d3-f375d1b606f7 req-d50b3e16-33c3-4556-9504-b3c5b9bb445d tempest-VolumesSnapshotsTestJSON-1445835600 None] Acquiring lock "cinder-aafc23e4-c61a-4194-9cda-bbc0d33be6cb-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-6c8f3080-de3d-4275-98d3-f375d1b606f7 req-d50b3e16-33c3-4556-9504-b3c5b9bb445d tempest-VolumesSnapshotsTestJSON-1445835600 None] Lock "cinder-aafc23e4-c61a-4194-9cda-bbc0d33be6cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-6c8f3080-de3d-4275-98d3-f375d1b606f7 req-d50b3e16-33c3-4556-9504-b3c5b9bb445d tempest-VolumesSnapshotsTestJSON-1445835600 None] Acquiring lock "cinder-quobyte-542cdf6e-cb82-4966-b890-9a926ad18655" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-6c8f3080-de3d-4275-98d3-f375d1b606f7 req-d50b3e16-33c3-4556-9504-b3c5b9bb445d tempest-VolumesSnapshotsTestJSON-1445835600 None] Lock "cinder-quobyte-542cdf6e-cb82-4966-b890-9a926ad18655" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-6c8f3080-de3d-4275-98d3-f375d1b606f7 req-d50b3e16-33c3-4556-9504-b3c5b9bb445d tempest-VolumesSnapshotsTestJSON-1445835600 None] Acquiring lock "cinder-quobyte-aafc23e4-c61a-4194-9cda-bbc0d33be6cb" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-6c8f3080-de3d-4275-98d3-f375d1b606f7 req-d50b3e16-33c3-4556-9504-b3c5b9bb445d tempest-VolumesSnapshotsTestJSON-1445835600 None] Lock "cinder-quobyte-aafc23e4-c61a-4194-9cda-bbc0d33be6cb" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:03 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [req-6c8f3080-de3d-4275-98d3-f375d1b606f7 req-d50b3e16-33c3-4556-9504-b3c5b9bb445d tempest-VolumesSnapshotsTestJSON-1445835600 None] Deleting offline snapshot aafc23e4-c61a-4194-9cda-bbc0d33be6cb of volume 542cdf6e-cb82-4966-b890-9a926ad18655 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:30:03 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [req-6c8f3080-de3d-4275-98d3-f375d1b606f7 req-d50b3e16-33c3-4556-9504-b3c5b9bb445d tempest-VolumesSnapshotsTestJSON-1445835600 None] snapshot_file for this snap is: volume-542cdf6e-cb82-4966-b890-9a926ad18655.aafc23e4-c61a-4194-9cda-bbc0d33be6cb {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:30:03 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e9bd9f-32c7-4fc2-a211-4152e4ab892a]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-6c8f3080-de3d-4275-98d3-f375d1b606f7 req-d50b3e16-33c3-4556-9504-b3c5b9bb445d tempest-VolumesSnapshotsTestJSON-1445835600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.aafc23e4-c61a-4194-9cda-bbc0d33be6cb {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:03 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.aafc23e4-c61a-4194-9cda-bbc0d33be6cb Jul 07 17:30:03 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:04 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cc517ec7-15ef-48ae-9578-6290334b17df 1073741824" returned: 0 in 1.227s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cc517ec7-15ef-48ae-9578-6290334b17df {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:04 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cc517ec7-15ef-48ae-9578-6290334b17df Jul 07 17:30:04 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:04 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=91,cinder:UPDATE=129,cinder:DELETE=13,cinder:INSERT=35 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:30:04 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Flow 'volume_create_manager' (2f99f4b4-c56c-43be-9533-c3f59c473529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3420681-524d-44d6-bad1-2ba8e02da349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3420681-524d-44d6-bad1-2ba8e02da349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-123735887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e9342c-3870-4c66-bb34-7d85667ab9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa07353508dd4b2f83e2ff37a3f4f92b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:04Z,use_quota=True,user_id='08518f6333ea42ff93d2b9b27c27b367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6836d49-9e0c-46a0-b439-c73520d4eb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6836d49-9e0c-46a0-b439-c73520d4eb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f64e5df-86d0-4491-8c1d-16cf5a8d66dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f64e5df-86d0-4491-8c1d-16cf5a8d66dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38e9342c-3870-4c66-bb34-7d85667ab9f6', 'volume_name': 'volume-38e9342c-3870-4c66-bb34-7d85667ab9f6', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0e8445-4b04-43f7-becb-4e26c928c452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0e8445-4b04-43f7-becb-4e26c928c452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e76cb25-7b35-452e-9c29-fe3d443e537f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:04 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Volume 38e9342c-3870-4c66-bb34-7d85667ab9f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38e9342c-3870-4c66-bb34-7d85667ab9f6', 'volume_size': 1} Jul 07 17:30:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:05 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-6c8f3080-de3d-4275-98d3-f375d1b606f7 req-d50b3e16-33c3-4556-9504-b3c5b9bb445d tempest-VolumesSnapshotsTestJSON-1445835600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.aafc23e4-c61a-4194-9cda-bbc0d33be6cb" returned: 0 in 1.324s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [req-6c8f3080-de3d-4275-98d3-f375d1b606f7 req-d50b3e16-33c3-4556-9504-b3c5b9bb445d tempest-VolumesSnapshotsTestJSON-1445835600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-542cdf6e-cb82-4966-b890-9a926ad18655(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fce07e2-4f6d-4071-ba25-9e99b85e97a8]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-6c8f3080-de3d-4275-98d3-f375d1b606f7 req-d50b3e16-33c3-4556-9504-b3c5b9bb445d tempest-VolumesSnapshotsTestJSON-1445835600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:05 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cc517ec7-15ef-48ae-9578-6290334b17df" returned: 0 in 1.119s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] <== create_volume: return (2425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.430s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.621s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-123735887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e9342c-3870-4c66-bb34-7d85667ab9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa07353508dd4b2f83e2ff37a3f4f92b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:04Z,use_quota=True,user_id='08518f6333ea42ff93d2b9b27c27b367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Creating volume 38e9342c-3870-4c66-bb34-7d85667ab9f6 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:05 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:05 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655 Jul 07 17:30:05 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f285880a-fccc-4f27-9220-a1736aeb3107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc517ec7-15ef-48ae-9578-6290334b17df', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:05 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 1073741824 Jul 07 17:30:05 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbd0c05-9da3-4901-9144-6623ca05acad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:05 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Volume volume-cc517ec7-15ef-48ae-9578-6290334b17df (cc517ec7-15ef-48ae-9578-6290334b17df): created successfully Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbd0c05-9da3-4901-9144-6623ca05acad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Flow 'volume_create_manager' (c235d144-e90c-4c7c-bc17-b4e2a7617824) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:05 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-7dcf610d-1a18-4745-87c2-ad4a3ab39d71 tempest-ProjectReaderTests-1226616585 None] Created volume successfully. Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Flow 'volume_create_manager' (55df1e30-b0ea-4b22-a838-709f2bd07883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ce5585-7122-4a87-850d-baa3b1b21bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ce5585-7122-4a87-850d-baa3b1b21bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-994283444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dbab408-e060-4331-b0ff-4c5f61c85bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ae438d28d249eea99040c039fc7539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:06Z,use_quota=True,user_id='e253fd9bfd434309b668dcc3b6d97660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b399a21e-e417-4809-89da-ac1933e0ca9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b399a21e-e417-4809-89da-ac1933e0ca9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc68f579-c542-4cd6-bbc8-d5565cd20255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc68f579-c542-4cd6-bbc8-d5565cd20255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dbab408-e060-4331-b0ff-4c5f61c85bd1', 'volume_name': 'volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25324533-d236-43f3-bb4d-ad953b174958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25324533-d236-43f3-bb4d-ad953b174958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e7c1b8-6359-4f23-987d-98560700cfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:05 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Volume 5dbab408-e060-4331-b0ff-4c5f61c85bd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1', 'volume_size': 1} Jul 07 17:30:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:06 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-6c8f3080-de3d-4275-98d3-f375d1b606f7 req-d50b3e16-33c3-4556-9504-b3c5b9bb445d tempest-VolumesSnapshotsTestJSON-1445835600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655" returned: 0 in 1.178s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-6c8f3080-de3d-4275-98d3-f375d1b606f7 req-d50b3e16-33c3-4556-9504-b3c5b9bb445d tempest-VolumesSnapshotsTestJSON-1445835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.aafc23e4-c61a-4194-9cda-bbc0d33be6cb {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:06 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.aafc23e4-c61a-4194-9cda-bbc0d33be6cb Jul 07 17:30:06 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:06 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 1073741824" returned: 0 in 1.310s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:06 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 Jul 07 17:30:06 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b57fd808-b1ed-4cbb-b4ef-a8741640d1b7 tempest-ProjectReaderTests-1226616585 None] Acquiring lock "cinder-cc517ec7-15ef-48ae-9578-6290334b17df-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b57fd808-b1ed-4cbb-b4ef-a8741640d1b7 tempest-ProjectReaderTests-1226616585 None] Lock "cinder-cc517ec7-15ef-48ae-9578-6290334b17df-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b57fd808-b1ed-4cbb-b4ef-a8741640d1b7 tempest-ProjectReaderTests-1226616585 None] Acquiring lock "cinder-quobyte-cc517ec7-15ef-48ae-9578-6290334b17df" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b57fd808-b1ed-4cbb-b4ef-a8741640d1b7 tempest-ProjectReaderTests-1226616585 None] Lock "cinder-quobyte-cc517ec7-15ef-48ae-9578-6290334b17df" acquired by "delete_volume" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:06 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc4818c-e449-4bda-a5a4-ba3b2b6c89fd]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b57fd808-b1ed-4cbb-b4ef-a8741640d1b7 tempest-ProjectReaderTests-1226616585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cc517ec7-15ef-48ae-9578-6290334b17df {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:07 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cc517ec7-15ef-48ae-9578-6290334b17df Jul 07 17:30:07 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:07 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-6c8f3080-de3d-4275-98d3-f375d1b606f7 req-d50b3e16-33c3-4556-9504-b3c5b9bb445d tempest-VolumesSnapshotsTestJSON-1445835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.aafc23e4-c61a-4194-9cda-bbc0d33be6cb" returned: 0 in 1.089s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-6c8f3080-de3d-4275-98d3-f375d1b606f7 req-d50b3e16-33c3-4556-9504-b3c5b9bb445d tempest-VolumesSnapshotsTestJSON-1445835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.aafc23e4-c61a-4194-9cda-bbc0d33be6cb {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:07 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.aafc23e4-c61a-4194-9cda-bbc0d33be6cb Jul 07 17:30:07 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:07 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6" returned: 0 in 0.883s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] <== create_volume: return (2296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:30:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.300s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.563s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-994283444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dbab408-e060-4331-b0ff-4c5f61c85bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ae438d28d249eea99040c039fc7539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:06Z,use_quota=True,user_id='e253fd9bfd434309b668dcc3b6d97660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Creating volume 5dbab408-e060-4331-b0ff-4c5f61c85bd1 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:07 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:30:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e76cb25-7b35-452e-9c29-fe3d443e537f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38e9342c-3870-4c66-bb34-7d85667ab9f6', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5257f03-4c14-4008-ac6b-8f3dccccdfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:07 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1 1073741824 Jul 07 17:30:07 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:07 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Volume volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 (38e9342c-3870-4c66-bb34-7d85667ab9f6): created successfully Jul 07 17:30:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5257f03-4c14-4008-ac6b-8f3dccccdfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Flow 'volume_create_manager' (2f99f4b4-c56c-43be-9533-c3f59c473529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:07 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-be6b3885-fc93-4c47-a92a-84c8adf5a1c3 tempest-TestStampPattern-407190565 None] Created volume successfully. Jul 07 17:30:07 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b57fd808-b1ed-4cbb-b4ef-a8741640d1b7 tempest-ProjectReaderTests-1226616585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cc517ec7-15ef-48ae-9578-6290334b17df" returned: 0 in 1.029s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b57fd808-b1ed-4cbb-b4ef-a8741640d1b7 tempest-ProjectReaderTests-1226616585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cc517ec7-15ef-48ae-9578-6290334b17df {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:07 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cc517ec7-15ef-48ae-9578-6290334b17df Jul 07 17:30:07 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:08 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-6c8f3080-de3d-4275-98d3-f375d1b606f7 req-d50b3e16-33c3-4556-9504-b3c5b9bb445d tempest-VolumesSnapshotsTestJSON-1445835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655.aafc23e4-c61a-4194-9cda-bbc0d33be6cb" returned: 0 in 0.806s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-6c8f3080-de3d-4275-98d3-f375d1b606f7 req-d50b3e16-33c3-4556-9504-b3c5b9bb445d tempest-VolumesSnapshotsTestJSON-1445835600 None] Lock "cinder-quobyte-aafc23e4-c61a-4194-9cda-bbc0d33be6cb" released by "_delete_snapshot" :: held 4.588s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-6c8f3080-de3d-4275-98d3-f375d1b606f7 req-d50b3e16-33c3-4556-9504-b3c5b9bb445d tempest-VolumesSnapshotsTestJSON-1445835600 None] Lock "cinder-quobyte-542cdf6e-cb82-4966-b890-9a926ad18655" released by "delete_snapshot" :: held 4.640s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:08 devstack cinder-volume[87303]: DEBUG cinder.quota [req-6c8f3080-de3d-4275-98d3-f375d1b606f7 req-d50b3e16-33c3-4556-9504-b3c5b9bb445d tempest-VolumesSnapshotsTestJSON-1445835600 None] Created reservations ['0bcd9163-5b4b-4f9a-b34f-dac99b4c3283', '8b15d322-4d4e-4d51-b570-8bee145ea388', 'f3ff96ae-3c5c-4136-8f47-9618d5d437fb', '860cb0e1-30b6-4180-a557-b306261106d5'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:08 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-6c8f3080-de3d-4275-98d3-f375d1b606f7 req-d50b3e16-33c3-4556-9504-b3c5b9bb445d tempest-VolumesSnapshotsTestJSON-1445835600 None] Delete snapshot completed successfully. Jul 07 17:30:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-6c8f3080-de3d-4275-98d3-f375d1b606f7 req-d50b3e16-33c3-4556-9504-b3c5b9bb445d tempest-VolumesSnapshotsTestJSON-1445835600 None] Lock "cinder-aafc23e4-c61a-4194-9cda-bbc0d33be6cb-delete_snapshot" released by "delete_snapshot" :: held 4.849s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:08 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1 1073741824" returned: 0 in 1.079s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:08 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1 Jul 07 17:30:08 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:08 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b57fd808-b1ed-4cbb-b4ef-a8741640d1b7 tempest-ProjectReaderTests-1226616585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cc517ec7-15ef-48ae-9578-6290334b17df" returned: 0 in 0.743s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b57fd808-b1ed-4cbb-b4ef-a8741640d1b7 tempest-ProjectReaderTests-1226616585 None] Lock "cinder-quobyte-cc517ec7-15ef-48ae-9578-6290334b17df" released by "delete_volume" :: held 1.840s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:08 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-b57fd808-b1ed-4cbb-b4ef-a8741640d1b7 tempest-ProjectReaderTests-1226616585 None] Created reservations ['1384a0cc-27ee-420f-ab29-166a1dbd0d29', 'b0582b20-26be-4770-ab5b-d1673da304b5', 'fa793a8b-45af-4b9d-802d-672ac77dc3c8', 'd234fe04-aba5-4691-b3b4-25115267d477'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b57fd808-b1ed-4cbb-b4ef-a8741640d1b7 tempest-ProjectReaderTests-1226616585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b57fd808-b1ed-4cbb-b4ef-a8741640d1b7 tempest-ProjectReaderTests-1226616585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b57fd808-b1ed-4cbb-b4ef-a8741640d1b7 tempest-ProjectReaderTests-1226616585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b57fd808-b1ed-4cbb-b4ef-a8741640d1b7 tempest-ProjectReaderTests-1226616585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b57fd808-b1ed-4cbb-b4ef-a8741640d1b7 tempest-ProjectReaderTests-1226616585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b57fd808-b1ed-4cbb-b4ef-a8741640d1b7 tempest-ProjectReaderTests-1226616585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:08 devstack sudo[98840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:30:08 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-08d83069-ee93-420a-9f09-1a0ee9401892 req-b7ba1393-41dd-4a20-b8dd-9d50ea0e4a38 tempest-VolumesSnapshotsTestJSON-1445835600 None] Acquiring lock "cinder-542cdf6e-cb82-4966-b890-9a926ad18655-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-08d83069-ee93-420a-9f09-1a0ee9401892 req-b7ba1393-41dd-4a20-b8dd-9d50ea0e4a38 tempest-VolumesSnapshotsTestJSON-1445835600 None] Lock "cinder-542cdf6e-cb82-4966-b890-9a926ad18655-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-08d83069-ee93-420a-9f09-1a0ee9401892 req-b7ba1393-41dd-4a20-b8dd-9d50ea0e4a38 tempest-VolumesSnapshotsTestJSON-1445835600 None] Acquiring lock "cinder-quobyte-542cdf6e-cb82-4966-b890-9a926ad18655" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-08d83069-ee93-420a-9f09-1a0ee9401892 req-b7ba1393-41dd-4a20-b8dd-9d50ea0e4a38 tempest-VolumesSnapshotsTestJSON-1445835600 None] Lock "cinder-quobyte-542cdf6e-cb82-4966-b890-9a926ad18655" acquired by "delete_volume" :: waited 0.028s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[1febfce0-1a74-49e4-acc3-eca4e4bb0a19]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-08d83069-ee93-420a-9f09-1a0ee9401892 req-b7ba1393-41dd-4a20-b8dd-9d50ea0e4a38 tempest-VolumesSnapshotsTestJSON-1445835600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:09 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1" returned: 0 in 0.999s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] <== create_volume: return (2125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.128s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e7c1b8-6359-4f23-987d-98560700cfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e2c0fc-e80c-4c5c-8201-7b5167810e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:09 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Volume volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1 (5dbab408-e060-4331-b0ff-4c5f61c85bd1): created successfully Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e2c0fc-e80c-4c5c-8201-7b5167810e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Flow 'volume_create_manager' (55df1e30-b0ea-4b22-a838-709f2bd07883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:09 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655 Jul 07 17:30:09 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:09 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-ec9d40be-9cc1-4674-af4f-17e9ed24a863 tempest-SnapshotMetadataTestJSON-1857650167 None] Created volume successfully. Jul 07 17:30:09 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b57fd808-b1ed-4cbb-b4ef-a8741640d1b7 tempest-ProjectReaderTests-1226616585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.893s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-b57fd808-b1ed-4cbb-b4ef-a8741640d1b7 tempest-ProjectReaderTests-1226616585 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Flow 'volume_create_manager' (a20c318d-a1a3-4747-8201-13194d23d661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8226f6cd-e1c6-4541-b1aa-354f6aacab40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:09 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b57fd808-b1ed-4cbb-b4ef-a8741640d1b7 tempest-ProjectReaderTests-1226616585 None] Deleted volume successfully. Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8226f6cd-e1c6-4541-b1aa-354f6aacab40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-179359528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f5951d4-b1d0-4d45-bfde-2573986f27d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50f5ba2dfec94959b87cda62243a11ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:10Z,use_quota=True,user_id='6374b2d7e3914166881008b8ad3ef947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a06de4-82ba-4a6d-9d44-4428f5a7a1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a06de4-82ba-4a6d-9d44-4428f5a7a1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3067374-ba44-4e2a-992d-d88b6093e0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3067374-ba44-4e2a-992d-d88b6093e0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f5951d4-b1d0-4d45-bfde-2573986f27d7', 'volume_name': 'volume-9f5951d4-b1d0-4d45-bfde-2573986f27d7', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb3a80f-025d-4929-81ab-a733385d06c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb3a80f-025d-4929-81ab-a733385d06c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd7364c-307f-4e15-b33e-656c0bbb6292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:09 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Volume 9f5951d4-b1d0-4d45-bfde-2573986f27d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f5951d4-b1d0-4d45-bfde-2573986f27d7', 'volume_size': 1} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-179359528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f5951d4-b1d0-4d45-bfde-2573986f27d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50f5ba2dfec94959b87cda62243a11ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:10Z,use_quota=True,user_id='6374b2d7e3914166881008b8ad3ef947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Creating volume 9f5951d4-b1d0-4d45-bfde-2573986f27d7 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:09 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:30:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9f5951d4-b1d0-4d45-bfde-2573986f27d7 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b57fd808-b1ed-4cbb-b4ef-a8741640d1b7 tempest-ProjectReaderTests-1226616585 None] Lock "cinder-cc517ec7-15ef-48ae-9578-6290334b17df-delete_volume" released by "delete_volume" :: held 3.215s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:10 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9f5951d4-b1d0-4d45-bfde-2573986f27d7 1073741824 Jul 07 17:30:10 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e5f489a5-e762-4ea7-a46b-c586c5d78e39 tempest-SnapshotMetadataTestJSON-1857650167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:10 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-08d83069-ee93-420a-9f09-1a0ee9401892 req-b7ba1393-41dd-4a20-b8dd-9d50ea0e4a38 tempest-VolumesSnapshotsTestJSON-1445835600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655" returned: 0 in 1.090s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-08d83069-ee93-420a-9f09-1a0ee9401892 req-b7ba1393-41dd-4a20-b8dd-9d50ea0e4a38 tempest-VolumesSnapshotsTestJSON-1445835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:10 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655 Jul 07 17:30:10 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:11 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9f5951d4-b1d0-4d45-bfde-2573986f27d7 1073741824" returned: 0 in 1.144s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9f5951d4-b1d0-4d45-bfde-2573986f27d7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:11 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9f5951d4-b1d0-4d45-bfde-2573986f27d7 Jul 07 17:30:11 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:11 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-08d83069-ee93-420a-9f09-1a0ee9401892 req-b7ba1393-41dd-4a20-b8dd-9d50ea0e4a38 tempest-VolumesSnapshotsTestJSON-1445835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-542cdf6e-cb82-4966-b890-9a926ad18655" returned: 0 in 0.988s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-08d83069-ee93-420a-9f09-1a0ee9401892 req-b7ba1393-41dd-4a20-b8dd-9d50ea0e4a38 tempest-VolumesSnapshotsTestJSON-1445835600 None] Lock "cinder-quobyte-542cdf6e-cb82-4966-b890-9a926ad18655" released by "delete_volume" :: held 2.223s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:11 devstack cinder-volume[87303]: DEBUG cinder.quota [req-08d83069-ee93-420a-9f09-1a0ee9401892 req-b7ba1393-41dd-4a20-b8dd-9d50ea0e4a38 tempest-VolumesSnapshotsTestJSON-1445835600 None] Created reservations ['e81e2cc3-337c-4a5f-9a99-3330d0b5174f', '90f6179d-4b6a-4f91-baab-0cba4031483d', '97c0bb03-235b-4789-8698-6884505faeb3', 'dc4d2e17-210e-4500-8ee0-a45e1774c9c5'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-08d83069-ee93-420a-9f09-1a0ee9401892 req-b7ba1393-41dd-4a20-b8dd-9d50ea0e4a38 tempest-VolumesSnapshotsTestJSON-1445835600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-08d83069-ee93-420a-9f09-1a0ee9401892 req-b7ba1393-41dd-4a20-b8dd-9d50ea0e4a38 tempest-VolumesSnapshotsTestJSON-1445835600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [req-08d83069-ee93-420a-9f09-1a0ee9401892 req-b7ba1393-41dd-4a20-b8dd-9d50ea0e4a38 tempest-VolumesSnapshotsTestJSON-1445835600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [req-08d83069-ee93-420a-9f09-1a0ee9401892 req-b7ba1393-41dd-4a20-b8dd-9d50ea0e4a38 tempest-VolumesSnapshotsTestJSON-1445835600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-08d83069-ee93-420a-9f09-1a0ee9401892 req-b7ba1393-41dd-4a20-b8dd-9d50ea0e4a38 tempest-VolumesSnapshotsTestJSON-1445835600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-08d83069-ee93-420a-9f09-1a0ee9401892 req-b7ba1393-41dd-4a20-b8dd-9d50ea0e4a38 tempest-VolumesSnapshotsTestJSON-1445835600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:11 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:30:11 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:12 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9f5951d4-b1d0-4d45-bfde-2573986f27d7" returned: 0 in 0.977s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] <== create_volume: return (2185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:30:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.188s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e5f489a5-e762-4ea7-a46b-c586c5d78e39 tempest-SnapshotMetadataTestJSON-1857650167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.870s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd7364c-307f-4e15-b33e-656c0bbb6292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f5951d4-b1d0-4d45-bfde-2573986f27d7', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a6e6eb-7df6-4828-a20f-bd7d73c705ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e5f489a5-e762-4ea7-a46b-c586c5d78e39 tempest-SnapshotMetadataTestJSON-1857650167 None] Creating offline snapshot 63d1c426-0958-4120-b4b4-449819cc702d of volume 5dbab408-e060-4331-b0ff-4c5f61c85bd1 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:30:12 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Volume volume-9f5951d4-b1d0-4d45-bfde-2573986f27d7 (9f5951d4-b1d0-4d45-bfde-2573986f27d7): created successfully Jul 07 17:30:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a6e6eb-7df6-4828-a20f-bd7d73c705ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Flow 'volume_create_manager' (a20c318d-a1a3-4747-8201-13194d23d661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:12 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[80312b4a-80e1-4636-b242-a700f4b300ce]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e5f489a5-e762-4ea7-a46b-c586c5d78e39 tempest-SnapshotMetadataTestJSON-1857650167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:12 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5d840664-c3f4-43ad-85f8-1b85a38bfc47 tempest-ProjectReaderTests-1226616585 None] Created volume successfully. Jul 07 17:30:12 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1 Jul 07 17:30:12 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:12 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-08d83069-ee93-420a-9f09-1a0ee9401892 req-b7ba1393-41dd-4a20-b8dd-9d50ea0e4a38 tempest-VolumesSnapshotsTestJSON-1445835600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.950s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:12 devstack cinder-volume[87303]: DEBUG cinder.manager [req-08d83069-ee93-420a-9f09-1a0ee9401892 req-b7ba1393-41dd-4a20-b8dd-9d50ea0e4a38 tempest-VolumesSnapshotsTestJSON-1445835600 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:12 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-08d83069-ee93-420a-9f09-1a0ee9401892 req-b7ba1393-41dd-4a20-b8dd-9d50ea0e4a38 tempest-VolumesSnapshotsTestJSON-1445835600 None] Deleted volume successfully. Jul 07 17:30:12 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-08d83069-ee93-420a-9f09-1a0ee9401892 req-b7ba1393-41dd-4a20-b8dd-9d50ea0e4a38 tempest-VolumesSnapshotsTestJSON-1445835600 None] Lock "cinder-542cdf6e-cb82-4966-b890-9a926ad18655-delete_volume" released by "delete_volume" :: held 3.568s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:13 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-91c815b1-1c5f-4763-9c4b-8433178f882f tempest-ProjectReaderTests-1226616585 None] Acquiring lock "cinder-9f5951d4-b1d0-4d45-bfde-2573986f27d7-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:13 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-91c815b1-1c5f-4763-9c4b-8433178f882f tempest-ProjectReaderTests-1226616585 None] Lock "cinder-9f5951d4-b1d0-4d45-bfde-2573986f27d7-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:13 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-91c815b1-1c5f-4763-9c4b-8433178f882f tempest-ProjectReaderTests-1226616585 None] Acquiring lock "cinder-quobyte-9f5951d4-b1d0-4d45-bfde-2573986f27d7" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:13 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-91c815b1-1c5f-4763-9c4b-8433178f882f tempest-ProjectReaderTests-1226616585 None] Lock "cinder-quobyte-9f5951d4-b1d0-4d45-bfde-2573986f27d7" acquired by "delete_volume" :: waited 0.027s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:13 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e5f489a5-e762-4ea7-a46b-c586c5d78e39 tempest-SnapshotMetadataTestJSON-1857650167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1" returned: 0 in 1.286s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e5f489a5-e762-4ea7-a46b-c586c5d78e39 tempest-SnapshotMetadataTestJSON-1857650167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.63d1c426-0958-4120-b4b4-449819cc702d 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:13 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0bdd3e-18b4-4ff2-9b4b-a6f9f4a519de]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-91c815b1-1c5f-4763-9c4b-8433178f882f tempest-ProjectReaderTests-1226616585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9f5951d4-b1d0-4d45-bfde-2573986f27d7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:13 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.63d1c426-0958-4120-b4b4-449819cc702d 1G Jul 07 17:30:13 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:13 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9f5951d4-b1d0-4d45-bfde-2573986f27d7 Jul 07 17:30:13 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:14 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-91c815b1-1c5f-4763-9c4b-8433178f882f tempest-ProjectReaderTests-1226616585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9f5951d4-b1d0-4d45-bfde-2573986f27d7" returned: 0 in 1.007s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-91c815b1-1c5f-4763-9c4b-8433178f882f tempest-ProjectReaderTests-1226616585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9f5951d4-b1d0-4d45-bfde-2573986f27d7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:14 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9f5951d4-b1d0-4d45-bfde-2573986f27d7 Jul 07 17:30:14 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:14 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e5f489a5-e762-4ea7-a46b-c586c5d78e39 tempest-SnapshotMetadataTestJSON-1857650167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.63d1c426-0958-4120-b4b4-449819cc702d 1G" returned: 0 in 1.148s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e5f489a5-e762-4ea7-a46b-c586c5d78e39 tempest-SnapshotMetadataTestJSON-1857650167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.63d1c426-0958-4120-b4b4-449819cc702d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:14 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.63d1c426-0958-4120-b4b4-449819cc702d Jul 07 17:30:14 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:15 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-91c815b1-1c5f-4763-9c4b-8433178f882f tempest-ProjectReaderTests-1226616585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9f5951d4-b1d0-4d45-bfde-2573986f27d7" returned: 0 in 0.820s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-91c815b1-1c5f-4763-9c4b-8433178f882f tempest-ProjectReaderTests-1226616585 None] Lock "cinder-quobyte-9f5951d4-b1d0-4d45-bfde-2573986f27d7" released by "delete_volume" :: held 1.914s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:15 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-91c815b1-1c5f-4763-9c4b-8433178f882f tempest-ProjectReaderTests-1226616585 None] Created reservations ['343f029f-4875-4fa2-b1df-ee4a2a43b936', '278cdec7-a36e-48a8-8f73-7805b30c6dda', 'ce0eddd5-b8a9-4486-aecf-bd39276ff920', '451769ed-613b-4e0d-b0aa-7e2148e9e160'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:15 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e5f489a5-e762-4ea7-a46b-c586c5d78e39 tempest-SnapshotMetadataTestJSON-1857650167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.63d1c426-0958-4120-b4b4-449819cc702d" returned: 0 in 0.938s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:15 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-e5f489a5-e762-4ea7-a46b-c586c5d78e39 tempest-SnapshotMetadataTestJSON-1857650167 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.63d1c426-0958-4120-b4b4-449819cc702d is being set with open permissions: ugo+rw Jul 07 17:30:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e5f489a5-e762-4ea7-a46b-c586c5d78e39 tempest-SnapshotMetadataTestJSON-1857650167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.63d1c426-0958-4120-b4b4-449819cc702d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:15 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.63d1c426-0958-4120-b4b4-449819cc702d Jul 07 17:30:15 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-91c815b1-1c5f-4763-9c4b-8433178f882f tempest-ProjectReaderTests-1226616585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-91c815b1-1c5f-4763-9c4b-8433178f882f tempest-ProjectReaderTests-1226616585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-91c815b1-1c5f-4763-9c4b-8433178f882f tempest-ProjectReaderTests-1226616585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-91c815b1-1c5f-4763-9c4b-8433178f882f tempest-ProjectReaderTests-1226616585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-91c815b1-1c5f-4763-9c4b-8433178f882f tempest-ProjectReaderTests-1226616585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-91c815b1-1c5f-4763-9c4b-8433178f882f tempest-ProjectReaderTests-1226616585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:15 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:30:15 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:16 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-91c815b1-1c5f-4763-9c4b-8433178f882f tempest-ProjectReaderTests-1226616585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.984s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:16 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-91c815b1-1c5f-4763-9c4b-8433178f882f tempest-ProjectReaderTests-1226616585 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:16 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-91c815b1-1c5f-4763-9c4b-8433178f882f tempest-ProjectReaderTests-1226616585 None] Deleted volume successfully. Jul 07 17:30:16 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-91c815b1-1c5f-4763-9c4b-8433178f882f tempest-ProjectReaderTests-1226616585 None] Lock "cinder-9f5951d4-b1d0-4d45-bfde-2573986f27d7-delete_volume" released by "delete_volume" :: held 3.401s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:16 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e5f489a5-e762-4ea7-a46b-c586c5d78e39 tempest-SnapshotMetadataTestJSON-1857650167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.63d1c426-0958-4120-b4b4-449819cc702d" returned: 0 in 1.163s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e5f489a5-e762-4ea7-a46b-c586c5d78e39 tempest-SnapshotMetadataTestJSON-1857650167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:16 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.info Jul 07 17:30:16 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:16 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Flow 'volume_create_manager' (1abe580f-01d9-470f-9eab-8ea10279ab38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38c5fe9-b0f5-4887-b296-5ac5be6f61e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38c5fe9-b0f5-4887-b296-5ac5be6f61e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-724265227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d22a54e-3c46-4db8-a1a5-7a3afd414594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50f5ba2dfec94959b87cda62243a11ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:17Z,use_quota=True,user_id='6374b2d7e3914166881008b8ad3ef947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3550e9b1-68b5-471a-acff-32190ced947a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3550e9b1-68b5-471a-acff-32190ced947a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e391b1a5-cd88-4603-b855-7a3febce261d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e391b1a5-cd88-4603-b855-7a3febce261d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d22a54e-3c46-4db8-a1a5-7a3afd414594', 'volume_name': 'volume-2d22a54e-3c46-4db8-a1a5-7a3afd414594', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5111c9e-858c-426b-82b0-6665d86f5a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5111c9e-858c-426b-82b0-6665d86f5a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d2bdbd-54ea-4eb6-9d69-c9a524da8d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:17 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Volume 2d22a54e-3c46-4db8-a1a5-7a3afd414594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d22a54e-3c46-4db8-a1a5-7a3afd414594', 'volume_size': 1} Jul 07 17:30:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:17 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e5f489a5-e762-4ea7-a46b-c586c5d78e39 tempest-SnapshotMetadataTestJSON-1857650167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.info" returned: 0 in 0.944s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:17 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-e5f489a5-e762-4ea7-a46b-c586c5d78e39 tempest-SnapshotMetadataTestJSON-1857650167 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.info is being set with open permissions: ugo+rw Jul 07 17:30:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e5f489a5-e762-4ea7-a46b-c586c5d78e39 tempest-SnapshotMetadataTestJSON-1857650167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:17 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.info Jul 07 17:30:17 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:18 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e5f489a5-e762-4ea7-a46b-c586c5d78e39 tempest-SnapshotMetadataTestJSON-1857650167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.info" returned: 0 in 0.940s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e5f489a5-e762-4ea7-a46b-c586c5d78e39 tempest-SnapshotMetadataTestJSON-1857650167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.591s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.729s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:18 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-724265227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d22a54e-3c46-4db8-a1a5-7a3afd414594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50f5ba2dfec94959b87cda62243a11ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:17Z,use_quota=True,user_id='6374b2d7e3914166881008b8ad3ef947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:18 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Creating volume 2d22a54e-3c46-4db8-a1a5-7a3afd414594 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:18 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:18 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:18 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:18 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:30:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2d22a54e-3c46-4db8-a1a5-7a3afd414594 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:18 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-e5f489a5-e762-4ea7-a46b-c586c5d78e39 tempest-SnapshotMetadataTestJSON-1857650167 None] Create snapshot completed successfully Jul 07 17:30:18 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2d22a54e-3c46-4db8-a1a5-7a3afd414594 1073741824 Jul 07 17:30:18 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:18 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Flow 'volume_create_manager' (a99e2026-fcc1-4c48-a141-fb72d3378e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a2f284-1a1c-449c-9f35-ed57b526bd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a2f284-1a1c-449c-9f35-ed57b526bd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-544140498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b058e76-ed18-4e8f-b32c-92245e1cf249,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51c1ef76c64043329822ff0e42872da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:19Z,use_quota=True,user_id='ed809c2363ca4d62a4924a217b4251b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5942a116-0acc-44ca-9535-f8d119e6f70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5942a116-0acc-44ca-9535-f8d119e6f70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736e93a6-1907-45be-abb1-029bde5b9b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736e93a6-1907-45be-abb1-029bde5b9b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b058e76-ed18-4e8f-b32c-92245e1cf249', 'volume_name': 'volume-2b058e76-ed18-4e8f-b32c-92245e1cf249', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f66a76d-cb9c-4bab-96ff-8aa71677c707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f66a76d-cb9c-4bab-96ff-8aa71677c707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5d5dd8-7c80-4bd7-8b86-5f581fbdc0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:19 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Volume 2b058e76-ed18-4e8f-b32c-92245e1cf249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b058e76-ed18-4e8f-b32c-92245e1cf249', 'volume_size': 1} Jul 07 17:30:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:19 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2d22a54e-3c46-4db8-a1a5-7a3afd414594 1073741824" returned: 0 in 1.041s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2d22a54e-3c46-4db8-a1a5-7a3afd414594 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:19 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2d22a54e-3c46-4db8-a1a5-7a3afd414594 Jul 07 17:30:19 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:20 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2d22a54e-3c46-4db8-a1a5-7a3afd414594" returned: 0 in 0.881s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:30:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.985s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.690s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-544140498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b058e76-ed18-4e8f-b32c-92245e1cf249,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51c1ef76c64043329822ff0e42872da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:19Z,use_quota=True,user_id='ed809c2363ca4d62a4924a217b4251b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Creating volume 2b058e76-ed18-4e8f-b32c-92245e1cf249 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:20 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:30:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b058e76-ed18-4e8f-b32c-92245e1cf249 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:20 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b058e76-ed18-4e8f-b32c-92245e1cf249 1073741824 Jul 07 17:30:20 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:20 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d2bdbd-54ea-4eb6-9d69-c9a524da8d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d22a54e-3c46-4db8-a1a5-7a3afd414594', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:20 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17161a36-d1cc-4f13-a70e-4576a14ee436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:20 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Volume volume-2d22a54e-3c46-4db8-a1a5-7a3afd414594 (2d22a54e-3c46-4db8-a1a5-7a3afd414594): created successfully Jul 07 17:30:20 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17161a36-d1cc-4f13-a70e-4576a14ee436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:20 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Flow 'volume_create_manager' (1abe580f-01d9-470f-9eab-8ea10279ab38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:21 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-26ec2ea2-64a8-403f-bd24-5ae7fbc77078 tempest-ProjectReaderTests-1226616585 None] Created volume successfully. Jul 07 17:30:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b29927f4-212b-4b8e-bba0-360486e4b96e tempest-SnapshotMetadataTestJSON-1857650167 None] Acquiring lock "cinder-63d1c426-0958-4120-b4b4-449819cc702d-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b29927f4-212b-4b8e-bba0-360486e4b96e tempest-SnapshotMetadataTestJSON-1857650167 None] Lock "cinder-63d1c426-0958-4120-b4b4-449819cc702d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b29927f4-212b-4b8e-bba0-360486e4b96e tempest-SnapshotMetadataTestJSON-1857650167 None] Acquiring lock "cinder-quobyte-5dbab408-e060-4331-b0ff-4c5f61c85bd1" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b29927f4-212b-4b8e-bba0-360486e4b96e tempest-SnapshotMetadataTestJSON-1857650167 None] Lock "cinder-quobyte-5dbab408-e060-4331-b0ff-4c5f61c85bd1" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b29927f4-212b-4b8e-bba0-360486e4b96e tempest-SnapshotMetadataTestJSON-1857650167 None] Acquiring lock "cinder-quobyte-63d1c426-0958-4120-b4b4-449819cc702d" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b29927f4-212b-4b8e-bba0-360486e4b96e tempest-SnapshotMetadataTestJSON-1857650167 None] Lock "cinder-quobyte-63d1c426-0958-4120-b4b4-449819cc702d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-b29927f4-212b-4b8e-bba0-360486e4b96e tempest-SnapshotMetadataTestJSON-1857650167 None] Deleting offline snapshot 63d1c426-0958-4120-b4b4-449819cc702d of volume 5dbab408-e060-4331-b0ff-4c5f61c85bd1 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:30:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-b29927f4-212b-4b8e-bba0-360486e4b96e tempest-SnapshotMetadataTestJSON-1857650167 None] snapshot_file for this snap is: volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.63d1c426-0958-4120-b4b4-449819cc702d {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:30:21 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[b339ea20-a9f7-466e-a299-be7826f70669]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b29927f4-212b-4b8e-bba0-360486e4b96e tempest-SnapshotMetadataTestJSON-1857650167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.63d1c426-0958-4120-b4b4-449819cc702d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-fa436508-7441-43fb-ba9a-2c6155694252 tempest-ProjectReaderTests-1226616585 None] Acquiring lock "cinder-2d22a54e-3c46-4db8-a1a5-7a3afd414594-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:21 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.63d1c426-0958-4120-b4b4-449819cc702d Jul 07 17:30:21 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-fa436508-7441-43fb-ba9a-2c6155694252 tempest-ProjectReaderTests-1226616585 None] Lock "cinder-2d22a54e-3c46-4db8-a1a5-7a3afd414594-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-fa436508-7441-43fb-ba9a-2c6155694252 tempest-ProjectReaderTests-1226616585 None] Acquiring lock "cinder-quobyte-2d22a54e-3c46-4db8-a1a5-7a3afd414594" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-fa436508-7441-43fb-ba9a-2c6155694252 tempest-ProjectReaderTests-1226616585 None] Lock "cinder-quobyte-2d22a54e-3c46-4db8-a1a5-7a3afd414594" acquired by "delete_volume" :: waited 0.027s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:21 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9be4eee-b67e-4c81-8fa6-ee8679aa9a64]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fa436508-7441-43fb-ba9a-2c6155694252 tempest-ProjectReaderTests-1226616585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2d22a54e-3c46-4db8-a1a5-7a3afd414594 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:21 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2d22a54e-3c46-4db8-a1a5-7a3afd414594 Jul 07 17:30:21 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:22 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b058e76-ed18-4e8f-b32c-92245e1cf249 1073741824" returned: 0 in 1.755s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b058e76-ed18-4e8f-b32c-92245e1cf249 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:22 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b058e76-ed18-4e8f-b32c-92245e1cf249 Jul 07 17:30:22 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:22 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b29927f4-212b-4b8e-bba0-360486e4b96e tempest-SnapshotMetadataTestJSON-1857650167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.63d1c426-0958-4120-b4b4-449819cc702d" returned: 0 in 1.805s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:23 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-b29927f4-212b-4b8e-bba0-360486e4b96e tempest-SnapshotMetadataTestJSON-1857650167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:30:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fa436508-7441-43fb-ba9a-2c6155694252 tempest-ProjectReaderTests-1226616585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2d22a54e-3c46-4db8-a1a5-7a3afd414594" returned: 0 in 1.372s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fa436508-7441-43fb-ba9a-2c6155694252 tempest-ProjectReaderTests-1226616585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2d22a54e-3c46-4db8-a1a5-7a3afd414594 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:23 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:23 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d921cd9f-cd6b-4842-b76e-f097cd68a8b3]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:23 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2d22a54e-3c46-4db8-a1a5-7a3afd414594 Jul 07 17:30:23 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b29927f4-212b-4b8e-bba0-360486e4b96e tempest-SnapshotMetadataTestJSON-1857650167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:23 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1 Jul 07 17:30:23 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:24 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b058e76-ed18-4e8f-b32c-92245e1cf249" returned: 0 in 1.445s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:24 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] <== create_volume: return (3298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:30:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.311s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5d5dd8-7c80-4bd7-8b86-5f581fbdc0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b058e76-ed18-4e8f-b32c-92245e1cf249', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0401188-446c-4e4e-97ed-81bfbffc3b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:24 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Volume volume-2b058e76-ed18-4e8f-b32c-92245e1cf249 (2b058e76-ed18-4e8f-b32c-92245e1cf249): created successfully Jul 07 17:30:24 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0401188-446c-4e4e-97ed-81bfbffc3b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Flow 'volume_create_manager' (a99e2026-fcc1-4c48-a141-fb72d3378e3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fa436508-7441-43fb-ba9a-2c6155694252 tempest-ProjectReaderTests-1226616585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2d22a54e-3c46-4db8-a1a5-7a3afd414594" returned: 0 in 1.097s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-fa436508-7441-43fb-ba9a-2c6155694252 tempest-ProjectReaderTests-1226616585 None] Lock "cinder-quobyte-2d22a54e-3c46-4db8-a1a5-7a3afd414594" released by "delete_volume" :: held 2.570s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:24 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-17c3ef1d-4681-43b5-9aa7-ff23b8f2defb req-2f64452b-fe52-403f-a0fc-1ae3486ebc81 tempest-VolumesGetTestJSON-990916245 None] Created volume successfully. Jul 07 17:30:24 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-fa436508-7441-43fb-ba9a-2c6155694252 tempest-ProjectReaderTests-1226616585 None] Created reservations ['11899c3d-1026-4f44-8ec3-0b827c09ffb9', '365a0ad8-4518-4d0b-880c-0ec6b0f837f9', '15cffcd5-7d11-438e-a4fa-c274e2047022', '977f4500-539a-489b-9b7e-9fb10c54cbde'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-fa436508-7441-43fb-ba9a-2c6155694252 tempest-ProjectReaderTests-1226616585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-fa436508-7441-43fb-ba9a-2c6155694252 tempest-ProjectReaderTests-1226616585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:24 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-fa436508-7441-43fb-ba9a-2c6155694252 tempest-ProjectReaderTests-1226616585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:24 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-fa436508-7441-43fb-ba9a-2c6155694252 tempest-ProjectReaderTests-1226616585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-fa436508-7441-43fb-ba9a-2c6155694252 tempest-ProjectReaderTests-1226616585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fa436508-7441-43fb-ba9a-2c6155694252 tempest-ProjectReaderTests-1226616585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:24 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b29927f4-212b-4b8e-bba0-360486e4b96e tempest-SnapshotMetadataTestJSON-1857650167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1" returned: 0 in 1.354s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b29927f4-212b-4b8e-bba0-360486e4b96e tempest-SnapshotMetadataTestJSON-1857650167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.63d1c426-0958-4120-b4b4-449819cc702d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:24 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:30:24 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:24 devstack sudo[99031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.63d1c426-0958-4120-b4b4-449819cc702d Jul 07 17:30:24 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-86025a26-f6df-4fd4-9fc0-cc0f1eed7cd5 req-ca1dd4f9-3009-4ebf-8293-2d5f1d814311 tempest-VolumesGetTestJSON-990916245 None] Acquiring lock "cinder-2b058e76-ed18-4e8f-b32c-92245e1cf249-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-86025a26-f6df-4fd4-9fc0-cc0f1eed7cd5 req-ca1dd4f9-3009-4ebf-8293-2d5f1d814311 tempest-VolumesGetTestJSON-990916245 None] Lock "cinder-2b058e76-ed18-4e8f-b32c-92245e1cf249-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-86025a26-f6df-4fd4-9fc0-cc0f1eed7cd5 req-ca1dd4f9-3009-4ebf-8293-2d5f1d814311 tempest-VolumesGetTestJSON-990916245 None] Acquiring lock "cinder-quobyte-2b058e76-ed18-4e8f-b32c-92245e1cf249" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-86025a26-f6df-4fd4-9fc0-cc0f1eed7cd5 req-ca1dd4f9-3009-4ebf-8293-2d5f1d814311 tempest-VolumesGetTestJSON-990916245 None] Lock "cinder-quobyte-2b058e76-ed18-4e8f-b32c-92245e1cf249" acquired by "delete_volume" :: waited 0.048s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:25 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44e898e-bd37-4a9f-aa3d-7ad959900d5b]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-86025a26-f6df-4fd4-9fc0-cc0f1eed7cd5 req-ca1dd4f9-3009-4ebf-8293-2d5f1d814311 tempest-VolumesGetTestJSON-990916245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b058e76-ed18-4e8f-b32c-92245e1cf249 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:25 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fa436508-7441-43fb-ba9a-2c6155694252 tempest-ProjectReaderTests-1226616585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.430s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:25 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-fa436508-7441-43fb-ba9a-2c6155694252 tempest-ProjectReaderTests-1226616585 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:25 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b058e76-ed18-4e8f-b32c-92245e1cf249 Jul 07 17:30:25 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:25 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-fa436508-7441-43fb-ba9a-2c6155694252 tempest-ProjectReaderTests-1226616585 None] Deleted volume successfully. Jul 07 17:30:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-fa436508-7441-43fb-ba9a-2c6155694252 tempest-ProjectReaderTests-1226616585 None] Lock "cinder-2d22a54e-3c46-4db8-a1a5-7a3afd414594-delete_volume" released by "delete_volume" :: held 4.446s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:26 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b29927f4-212b-4b8e-bba0-360486e4b96e tempest-SnapshotMetadataTestJSON-1857650167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.63d1c426-0958-4120-b4b4-449819cc702d" returned: 0 in 1.608s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b29927f4-212b-4b8e-bba0-360486e4b96e tempest-SnapshotMetadataTestJSON-1857650167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.63d1c426-0958-4120-b4b4-449819cc702d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:26 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.63d1c426-0958-4120-b4b4-449819cc702d Jul 07 17:30:26 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:26 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-86025a26-f6df-4fd4-9fc0-cc0f1eed7cd5 req-ca1dd4f9-3009-4ebf-8293-2d5f1d814311 tempest-VolumesGetTestJSON-990916245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b058e76-ed18-4e8f-b32c-92245e1cf249" returned: 0 in 1.210s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-86025a26-f6df-4fd4-9fc0-cc0f1eed7cd5 req-ca1dd4f9-3009-4ebf-8293-2d5f1d814311 tempest-VolumesGetTestJSON-990916245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b058e76-ed18-4e8f-b32c-92245e1cf249 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:27 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b058e76-ed18-4e8f-b32c-92245e1cf249 Jul 07 17:30:27 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:27 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b29927f4-212b-4b8e-bba0-360486e4b96e tempest-SnapshotMetadataTestJSON-1857650167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1.63d1c426-0958-4120-b4b4-449819cc702d" returned: 0 in 1.122s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b29927f4-212b-4b8e-bba0-360486e4b96e tempest-SnapshotMetadataTestJSON-1857650167 None] Lock "cinder-quobyte-63d1c426-0958-4120-b4b4-449819cc702d" released by "_delete_snapshot" :: held 6.216s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b29927f4-212b-4b8e-bba0-360486e4b96e tempest-SnapshotMetadataTestJSON-1857650167 None] Lock "cinder-quobyte-5dbab408-e060-4331-b0ff-4c5f61c85bd1" released by "delete_snapshot" :: held 6.258s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:27 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-b29927f4-212b-4b8e-bba0-360486e4b96e tempest-SnapshotMetadataTestJSON-1857650167 None] Created reservations ['52d3abd3-8530-4ccd-8e1e-571af363bae0', 'fc450ed2-ce04-4deb-9664-06e265b26762', 'e10dbfad-014a-4523-a9cc-5f209ced6439', '9466d71a-9cbe-42ed-80f6-344a4ff2c6a2'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:27 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b29927f4-212b-4b8e-bba0-360486e4b96e tempest-SnapshotMetadataTestJSON-1857650167 None] Delete snapshot completed successfully. Jul 07 17:30:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b29927f4-212b-4b8e-bba0-360486e4b96e tempest-SnapshotMetadataTestJSON-1857650167 None] Lock "cinder-63d1c426-0958-4120-b4b4-449819cc702d-delete_snapshot" released by "delete_snapshot" :: held 6.739s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:27 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-86025a26-f6df-4fd4-9fc0-cc0f1eed7cd5 req-ca1dd4f9-3009-4ebf-8293-2d5f1d814311 tempest-VolumesGetTestJSON-990916245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b058e76-ed18-4e8f-b32c-92245e1cf249" returned: 0 in 1.018s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-86025a26-f6df-4fd4-9fc0-cc0f1eed7cd5 req-ca1dd4f9-3009-4ebf-8293-2d5f1d814311 tempest-VolumesGetTestJSON-990916245 None] Lock "cinder-quobyte-2b058e76-ed18-4e8f-b32c-92245e1cf249" released by "delete_volume" :: held 2.337s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:28 devstack cinder-volume[87303]: DEBUG cinder.quota [req-86025a26-f6df-4fd4-9fc0-cc0f1eed7cd5 req-ca1dd4f9-3009-4ebf-8293-2d5f1d814311 tempest-VolumesGetTestJSON-990916245 None] Created reservations ['71505e1d-65bc-4e30-a18d-27a2c87efd93', '0e6ce47e-2e08-4354-bda6-e369f1551147', 'f2d8d6f5-75bd-4036-ada8-b9613be99b83', '2c9b0079-3ddc-42d9-be13-1c6e1f55ecd4'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-86025a26-f6df-4fd4-9fc0-cc0f1eed7cd5 req-ca1dd4f9-3009-4ebf-8293-2d5f1d814311 tempest-VolumesGetTestJSON-990916245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-86025a26-f6df-4fd4-9fc0-cc0f1eed7cd5 req-ca1dd4f9-3009-4ebf-8293-2d5f1d814311 tempest-VolumesGetTestJSON-990916245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [req-86025a26-f6df-4fd4-9fc0-cc0f1eed7cd5 req-ca1dd4f9-3009-4ebf-8293-2d5f1d814311 tempest-VolumesGetTestJSON-990916245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [req-86025a26-f6df-4fd4-9fc0-cc0f1eed7cd5 req-ca1dd4f9-3009-4ebf-8293-2d5f1d814311 tempest-VolumesGetTestJSON-990916245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-86025a26-f6df-4fd4-9fc0-cc0f1eed7cd5 req-ca1dd4f9-3009-4ebf-8293-2d5f1d814311 tempest-VolumesGetTestJSON-990916245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-86025a26-f6df-4fd4-9fc0-cc0f1eed7cd5 req-ca1dd4f9-3009-4ebf-8293-2d5f1d814311 tempest-VolumesGetTestJSON-990916245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:28 devstack sudo[99051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:30:28 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5e0ed764-82d8-4178-b112-2a103140da21 tempest-SnapshotMetadataTestJSON-1857650167 None] Acquiring lock "cinder-5dbab408-e060-4331-b0ff-4c5f61c85bd1-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5e0ed764-82d8-4178-b112-2a103140da21 tempest-SnapshotMetadataTestJSON-1857650167 None] Lock "cinder-5dbab408-e060-4331-b0ff-4c5f61c85bd1-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5e0ed764-82d8-4178-b112-2a103140da21 tempest-SnapshotMetadataTestJSON-1857650167 None] Acquiring lock "cinder-quobyte-5dbab408-e060-4331-b0ff-4c5f61c85bd1" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5e0ed764-82d8-4178-b112-2a103140da21 tempest-SnapshotMetadataTestJSON-1857650167 None] Lock "cinder-quobyte-5dbab408-e060-4331-b0ff-4c5f61c85bd1" acquired by "delete_volume" :: waited 0.030s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:29 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22292ff-7d02-471b-a6ab-0c90e01149a6]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5e0ed764-82d8-4178-b112-2a103140da21 tempest-SnapshotMetadataTestJSON-1857650167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:29 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1 Jul 07 17:30:29 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:29 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-86025a26-f6df-4fd4-9fc0-cc0f1eed7cd5 req-ca1dd4f9-3009-4ebf-8293-2d5f1d814311 tempest-VolumesGetTestJSON-990916245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.476s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:29 devstack cinder-volume[87303]: DEBUG cinder.manager [req-86025a26-f6df-4fd4-9fc0-cc0f1eed7cd5 req-ca1dd4f9-3009-4ebf-8293-2d5f1d814311 tempest-VolumesGetTestJSON-990916245 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:29 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-86025a26-f6df-4fd4-9fc0-cc0f1eed7cd5 req-ca1dd4f9-3009-4ebf-8293-2d5f1d814311 tempest-VolumesGetTestJSON-990916245 None] Deleted volume successfully. Jul 07 17:30:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [req-86025a26-f6df-4fd4-9fc0-cc0f1eed7cd5 req-ca1dd4f9-3009-4ebf-8293-2d5f1d814311 tempest-VolumesGetTestJSON-990916245 None] Lock "cinder-2b058e76-ed18-4e8f-b32c-92245e1cf249-delete_volume" released by "delete_volume" :: held 4.311s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:30 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5e0ed764-82d8-4178-b112-2a103140da21 tempest-SnapshotMetadataTestJSON-1857650167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1" returned: 0 in 1.365s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5e0ed764-82d8-4178-b112-2a103140da21 tempest-SnapshotMetadataTestJSON-1857650167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:30 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1 Jul 07 17:30:30 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:31 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5e0ed764-82d8-4178-b112-2a103140da21 tempest-SnapshotMetadataTestJSON-1857650167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5dbab408-e060-4331-b0ff-4c5f61c85bd1" returned: 0 in 1.002s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5e0ed764-82d8-4178-b112-2a103140da21 tempest-SnapshotMetadataTestJSON-1857650167 None] Lock "cinder-quobyte-5dbab408-e060-4331-b0ff-4c5f61c85bd1" released by "delete_volume" :: held 2.518s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:31 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-5e0ed764-82d8-4178-b112-2a103140da21 tempest-SnapshotMetadataTestJSON-1857650167 None] Created reservations ['1bcc571f-7929-4fc0-961d-5ca6845f427c', '9136b1ed-b71e-4470-90d6-239f556fe5aa', 'cdab8161-6c6e-4903-abf6-e35790353a5b', 'ddbac161-b2fb-411f-abba-e0a6f282a352'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5e0ed764-82d8-4178-b112-2a103140da21 tempest-SnapshotMetadataTestJSON-1857650167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5e0ed764-82d8-4178-b112-2a103140da21 tempest-SnapshotMetadataTestJSON-1857650167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5e0ed764-82d8-4178-b112-2a103140da21 tempest-SnapshotMetadataTestJSON-1857650167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5e0ed764-82d8-4178-b112-2a103140da21 tempest-SnapshotMetadataTestJSON-1857650167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5e0ed764-82d8-4178-b112-2a103140da21 tempest-SnapshotMetadataTestJSON-1857650167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5e0ed764-82d8-4178-b112-2a103140da21 tempest-SnapshotMetadataTestJSON-1857650167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:31 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:30:31 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:32 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5e0ed764-82d8-4178-b112-2a103140da21 tempest-SnapshotMetadataTestJSON-1857650167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.752s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:32 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-5e0ed764-82d8-4178-b112-2a103140da21 tempest-SnapshotMetadataTestJSON-1857650167 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:32 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5e0ed764-82d8-4178-b112-2a103140da21 tempest-SnapshotMetadataTestJSON-1857650167 None] Deleted volume successfully. Jul 07 17:30:32 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5e0ed764-82d8-4178-b112-2a103140da21 tempest-SnapshotMetadataTestJSON-1857650167 None] Lock "cinder-5dbab408-e060-4331-b0ff-4c5f61c85bd1-delete_volume" released by "delete_volume" :: held 3.627s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:35 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-34be2066-e255-4b92-aef4-2e8c2a2a238e tempest-GroupSnapshotsTest-1684738746 None] Group tempest-GroupSnapshotsTest-Group-733023032: creating Jul 07 17:30:35 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-34be2066-e255-4b92-aef4-2e8c2a2a238e tempest-GroupSnapshotsTest-1684738746 None] Group tempest-GroupSnapshotsTest-Group-733023032: created successfully Jul 07 17:30:35 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-34be2066-e255-4b92-aef4-2e8c2a2a238e tempest-GroupSnapshotsTest-1684738746 None] Create group completed successfully. Jul 07 17:30:37 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Flow 'volume_create_manager' (aa8ddb7a-3f0c-4c5f-a0fa-601b6fb5bb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e938b1-9900-486b-8d81-1154fd7104ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e938b1-9900-486b-8d81-1154fd7104ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-391970256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef0dd1ef-8d12-46af-8f22-d197bd71f2c6,host='devstack@QuobyteHD#QuobyteHD',id=7ca1c75d-a863-4016-a605-119cce60d8af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bf690e56ad4cac825da95f67d485ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:37Z,use_quota=True,user_id='c66f97be2ff945cd87f6359c4986d156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(403ee302-704d-45b0-9288-80907ee60e42),volume_type_id=403ee302-704d-45b0-9288-80907ee60e42)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0ecc4b-4699-4bbb-a997-c1c1ade458b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0ecc4b-4699-4bbb-a997-c1c1ade458b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068ffc80-ab04-43c6-aef1-cc6cf1e9462b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068ffc80-ab04-43c6-aef1-cc6cf1e9462b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ca1c75d-a863-4016-a605-119cce60d8af', 'volume_name': 'volume-7ca1c75d-a863-4016-a605-119cce60d8af', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7da594-1c57-4bc0-bb9a-9699396c54c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7da594-1c57-4bc0-bb9a-9699396c54c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d979cd4-cde5-4352-a591-bbbc399c7cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:37 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Volume 7ca1c75d-a863-4016-a605-119cce60d8af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ca1c75d-a863-4016-a605-119cce60d8af', 'volume_size': 1} Jul 07 17:30:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ef0dd1ef-8d12-46af-8f22-d197bd71f2c6,created_at=2026-07-07T15:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-391970256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef0dd1ef-8d12-46af-8f22-d197bd71f2c6,host='devstack@QuobyteHD#QuobyteHD',id=7ca1c75d-a863-4016-a605-119cce60d8af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bf690e56ad4cac825da95f67d485ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:37Z,use_quota=True,user_id='c66f97be2ff945cd87f6359c4986d156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(403ee302-704d-45b0-9288-80907ee60e42),volume_type_id=403ee302-704d-45b0-9288-80907ee60e42)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Creating volume 7ca1c75d-a863-4016-a605-119cce60d8af {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:37 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:30:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:37 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af 1073741824 Jul 07 17:30:37 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:38 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af 1073741824" returned: 0 in 1.253s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:38 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=91,cinder:UPDATE=130,cinder:INSERT=35,cinder:DELETE=10 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:30:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:38 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af Jul 07 17:30:38 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:39 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af" returned: 0 in 0.808s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:39 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] <== create_volume: return (2151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:30:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.154s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d979cd4-cde5-4352-a591-bbbc399c7cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ca1c75d-a863-4016-a605-119cce60d8af', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (623d1e87-94cc-4594-a2bb-1529d30f73df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:39 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Volume volume-7ca1c75d-a863-4016-a605-119cce60d8af (7ca1c75d-a863-4016-a605-119cce60d8af): created successfully Jul 07 17:30:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (623d1e87-94cc-4594-a2bb-1529d30f73df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Flow 'volume_create_manager' (aa8ddb7a-3f0c-4c5f-a0fa-601b6fb5bb1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:39 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-481565c2-4d94-46db-b64a-13498a535ab3 tempest-GroupSnapshotsTest-1684738746 None] Created volume successfully. Jul 07 17:30:39 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Flow 'volume_create_manager' (cbeda560-9658-4e92-a32a-ffd782c5bea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72398bc-1a1c-4511-b320-9f596801e3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72398bc-1a1c-4511-b320-9f596801e3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-272278853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52af53e4-e090-4e0e-9342-dca5efc72c46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed9dcecc0fbf4822954e65037188c3e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:40Z,use_quota=True,user_id='8a92c03f53d5423d9098222e7957cc2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307b959d-3242-4135-b271-f4ed73e9662c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307b959d-3242-4135-b271-f4ed73e9662c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b879224-969c-4882-afd8-eb101f9db4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b879224-969c-4882-afd8-eb101f9db4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52af53e4-e090-4e0e-9342-dca5efc72c46', 'volume_name': 'volume-52af53e4-e090-4e0e-9342-dca5efc72c46', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03c5293-5064-45b7-98a9-bd6b3efc7e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03c5293-5064-45b7-98a9-bd6b3efc7e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca812345-714f-49bf-b93f-42a62f56d087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:40 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Volume 52af53e4-e090-4e0e-9342-dca5efc72c46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52af53e4-e090-4e0e-9342-dca5efc72c46', 'volume_size': 1} Jul 07 17:30:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:40 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-272278853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52af53e4-e090-4e0e-9342-dca5efc72c46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed9dcecc0fbf4822954e65037188c3e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:40Z,use_quota=True,user_id='8a92c03f53d5423d9098222e7957cc2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:30:40 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Creating volume 52af53e4-e090-4e0e-9342-dca5efc72c46 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:30:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:40 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:40 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:40 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:40 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:30:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-52af53e4-e090-4e0e-9342-dca5efc72c46 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:40 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-52af53e4-e090-4e0e-9342-dca5efc72c46 1073741824 Jul 07 17:30:40 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:41 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-52af53e4-e090-4e0e-9342-dca5efc72c46 1073741824" returned: 0 in 1.255s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-52af53e4-e090-4e0e-9342-dca5efc72c46 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:41 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-52af53e4-e090-4e0e-9342-dca5efc72c46 Jul 07 17:30:41 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:41 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-0ed8f790-9cfd-4924-9f78-669f6f0d53e3 tempest-GroupSnapshotsTest-1684738746 None] GroupSnapshot 30edb2cf-809a-4382-9954-758b7eb3fd2e: creating. Jul 07 17:30:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0ed8f790-9cfd-4924-9f78-669f6f0d53e3 tempest-GroupSnapshotsTest-1684738746 None] Group snapshot 30edb2cf-809a-4382-9954-758b7eb3fd2e: creating. {{(pid=87303) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 17:30:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0ed8f790-9cfd-4924-9f78-669f6f0d53e3 tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:42 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-52af53e4-e090-4e0e-9342-dca5efc72c46" returned: 0 in 0.819s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] <== create_volume: return (2143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:30:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.145s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0ed8f790-9cfd-4924-9f78-669f6f0d53e3 tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.565s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-0ed8f790-9cfd-4924-9f78-669f6f0d53e3 tempest-GroupSnapshotsTest-1684738746 None] Creating offline snapshot bcfa9fe5-6883-4efe-8eda-c4bce70399ec of volume 7ca1c75d-a863-4016-a605-119cce60d8af {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:30:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca812345-714f-49bf-b93f-42a62f56d087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52af53e4-e090-4e0e-9342-dca5efc72c46', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bba8968-1929-4cec-9f7a-fc6e0ac4ee90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:42 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c558ea-2b19-452d-9eab-336259e4dad4]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0ed8f790-9cfd-4924-9f78-669f6f0d53e3 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:42 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Volume volume-52af53e4-e090-4e0e-9342-dca5efc72c46 (52af53e4-e090-4e0e-9342-dca5efc72c46): created successfully Jul 07 17:30:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bba8968-1929-4cec-9f7a-fc6e0ac4ee90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Flow 'volume_create_manager' (cbeda560-9658-4e92-a32a-ffd782c5bea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:42 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-488699db-05b3-4c6c-8023-c6fead5b8286 tempest-VolumesMetadataTest-685110893 None] Created volume successfully. Jul 07 17:30:42 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af Jul 07 17:30:42 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:43 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0ed8f790-9cfd-4924-9f78-669f6f0d53e3 tempest-GroupSnapshotsTest-1684738746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af" returned: 0 in 1.282s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0ed8f790-9cfd-4924-9f78-669f6f0d53e3 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.bcfa9fe5-6883-4efe-8eda-c4bce70399ec 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:43 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.bcfa9fe5-6883-4efe-8eda-c4bce70399ec 1G Jul 07 17:30:43 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:44 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-07609af5-2df4-49a9-b29a-fae8df83bd95 tempest-VolumesMetadataTest-685110893 None] Acquiring lock "cinder-52af53e4-e090-4e0e-9342-dca5efc72c46-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:44 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-07609af5-2df4-49a9-b29a-fae8df83bd95 tempest-VolumesMetadataTest-685110893 None] Lock "cinder-52af53e4-e090-4e0e-9342-dca5efc72c46-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:44 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-07609af5-2df4-49a9-b29a-fae8df83bd95 tempest-VolumesMetadataTest-685110893 None] Acquiring lock "cinder-quobyte-52af53e4-e090-4e0e-9342-dca5efc72c46" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:44 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-07609af5-2df4-49a9-b29a-fae8df83bd95 tempest-VolumesMetadataTest-685110893 None] Lock "cinder-quobyte-52af53e4-e090-4e0e-9342-dca5efc72c46" acquired by "delete_volume" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:44 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c10d0bd-8e15-4505-8172-8655300583ca]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-07609af5-2df4-49a9-b29a-fae8df83bd95 tempest-VolumesMetadataTest-685110893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-52af53e4-e090-4e0e-9342-dca5efc72c46 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:44 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-52af53e4-e090-4e0e-9342-dca5efc72c46 Jul 07 17:30:44 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:44 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0ed8f790-9cfd-4924-9f78-669f6f0d53e3 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.bcfa9fe5-6883-4efe-8eda-c4bce70399ec 1G" returned: 0 in 1.062s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0ed8f790-9cfd-4924-9f78-669f6f0d53e3 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca1c75d-a863-4016-a605-119cce60d8af -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.bcfa9fe5-6883-4efe-8eda-c4bce70399ec {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:44 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca1c75d-a863-4016-a605-119cce60d8af -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.bcfa9fe5-6883-4efe-8eda-c4bce70399ec Jul 07 17:30:44 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:45 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-07609af5-2df4-49a9-b29a-fae8df83bd95 tempest-VolumesMetadataTest-685110893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-52af53e4-e090-4e0e-9342-dca5efc72c46" returned: 0 in 0.917s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-07609af5-2df4-49a9-b29a-fae8df83bd95 tempest-VolumesMetadataTest-685110893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-52af53e4-e090-4e0e-9342-dca5efc72c46 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:45 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-52af53e4-e090-4e0e-9342-dca5efc72c46 Jul 07 17:30:45 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:45 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0ed8f790-9cfd-4924-9f78-669f6f0d53e3 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca1c75d-a863-4016-a605-119cce60d8af -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.bcfa9fe5-6883-4efe-8eda-c4bce70399ec" returned: 0 in 0.897s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:45 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-0ed8f790-9cfd-4924-9f78-669f6f0d53e3 tempest-GroupSnapshotsTest-1684738746 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.bcfa9fe5-6883-4efe-8eda-c4bce70399ec is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:30:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0ed8f790-9cfd-4924-9f78-669f6f0d53e3 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.bcfa9fe5-6883-4efe-8eda-c4bce70399ec {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:45 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.bcfa9fe5-6883-4efe-8eda-c4bce70399ec Jul 07 17:30:45 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:46 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-07609af5-2df4-49a9-b29a-fae8df83bd95 tempest-VolumesMetadataTest-685110893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-52af53e4-e090-4e0e-9342-dca5efc72c46" returned: 0 in 0.815s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:46 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-07609af5-2df4-49a9-b29a-fae8df83bd95 tempest-VolumesMetadataTest-685110893 None] Lock "cinder-quobyte-52af53e4-e090-4e0e-9342-dca5efc72c46" released by "delete_volume" :: held 1.782s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:46 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-07609af5-2df4-49a9-b29a-fae8df83bd95 tempest-VolumesMetadataTest-685110893 None] Created reservations ['78729668-7afa-445c-94d6-a8a60fcc53b4', '860e2f58-0ee0-4d06-812f-2c4835e92244', 'd80d88ee-6b40-4a77-94fa-a6beaf93fb92', '7216a9c4-789e-49d3-9455-6e465e671aa7'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:30:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-07609af5-2df4-49a9-b29a-fae8df83bd95 tempest-VolumesMetadataTest-685110893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-07609af5-2df4-49a9-b29a-fae8df83bd95 tempest-VolumesMetadataTest-685110893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-07609af5-2df4-49a9-b29a-fae8df83bd95 tempest-VolumesMetadataTest-685110893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-07609af5-2df4-49a9-b29a-fae8df83bd95 tempest-VolumesMetadataTest-685110893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-07609af5-2df4-49a9-b29a-fae8df83bd95 tempest-VolumesMetadataTest-685110893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-07609af5-2df4-49a9-b29a-fae8df83bd95 tempest-VolumesMetadataTest-685110893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:46 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:30:46 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:46 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0ed8f790-9cfd-4924-9f78-669f6f0d53e3 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.bcfa9fe5-6883-4efe-8eda-c4bce70399ec" returned: 0 in 0.976s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0ed8f790-9cfd-4924-9f78-669f6f0d53e3 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:46 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.info Jul 07 17:30:46 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:47 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-07609af5-2df4-49a9-b29a-fae8df83bd95 tempest-VolumesMetadataTest-685110893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.801s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:47 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-07609af5-2df4-49a9-b29a-fae8df83bd95 tempest-VolumesMetadataTest-685110893 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:47 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-07609af5-2df4-49a9-b29a-fae8df83bd95 tempest-VolumesMetadataTest-685110893 None] Deleted volume successfully. Jul 07 17:30:47 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-07609af5-2df4-49a9-b29a-fae8df83bd95 tempest-VolumesMetadataTest-685110893 None] Lock "cinder-52af53e4-e090-4e0e-9342-dca5efc72c46-delete_volume" released by "delete_volume" :: held 2.884s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:30:47 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0ed8f790-9cfd-4924-9f78-669f6f0d53e3 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.info" returned: 0 in 0.951s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:47 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-0ed8f790-9cfd-4924-9f78-669f6f0d53e3 tempest-GroupSnapshotsTest-1684738746 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:30:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0ed8f790-9cfd-4924-9f78-669f6f0d53e3 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:47 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.info Jul 07 17:30:47 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:48 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0ed8f790-9cfd-4924-9f78-669f6f0d53e3 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.info" returned: 0 in 0.887s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0ed8f790-9cfd-4924-9f78-669f6f0d53e3 tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.197s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:48 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-0ed8f790-9cfd-4924-9f78-669f6f0d53e3 tempest-GroupSnapshotsTest-1684738746 None] group_snapshot 30edb2cf-809a-4382-9954-758b7eb3fd2e: created successfully Jul 07 17:30:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:50 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "cinder-quobyte-bcfa9fe5-6883-4efe-8eda-c4bce70399ec-b8105903-c791-48bc-80df-f164db103602" by "_create_volume_from_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:50 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-bcfa9fe5-6883-4efe-8eda-c4bce70399ec-b8105903-c791-48bc-80df-f164db103602" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Creating volume b8105903-c791-48bc-80df-f164db103602 from snapshot bcfa9fe5-6883-4efe-8eda-c4bce70399ec {{(pid=87303) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:30:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:30:50 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "cinder-quobyte-b8105903-c791-48bc-80df-f164db103602" by "_copy_volume_from_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:30:50 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-b8105903-c791-48bc-80df-f164db103602" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:30:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] snapshot: bcfa9fe5-6883-4efe-8eda-c4bce70399ec, volume: b8105903-c791-48bc-80df-f164db103602, {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:30:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:50 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[03be9964-7a3e-40dc-8c52-9b61a1fb641a]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.bcfa9fe5-6883-4efe-8eda-c4bce70399ec {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:50 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.bcfa9fe5-6883-4efe-8eda-c4bce70399ec Jul 07 17:30:50 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-64bbd54e-53ca-441e-8008-5ae5e977b72b req-410979c4-d339-4a30-b0ed-1ec0da378c97 tempest-TestStampPattern-407190565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:51 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.bcfa9fe5-6883-4efe-8eda-c4bce70399ec" returned: 0 in 0.922s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ca1c75d-a863-4016-a605-119cce60d8af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:30:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:30:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Creating direct copy from snapshot {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:30:51 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[03408a26-38d6-4012-a697-72c90acc2ac7]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:51 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af Jul 07 17:30:51 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:52 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:30:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Flow 'volume_create_manager' (78eab3a7-4e4e-4cf0-8432-d3d23fde0738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:30:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a0b8cb-f705-46a7-aca6-47a2029dcbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a0b8cb-f705-46a7-aca6-47a2029dcbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-667751813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=464f0b6d-49ed-4340-8390-246017f5223a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c9ee5a20604fca96cef18937ba2b84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:52Z,use_quota=True,user_id='372d25c33889456499097346e1a8c3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe7550a-cb89-43a3-a5f2-600415dbc98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe7550a-cb89-43a3-a5f2-600415dbc98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe75ec9-7e71-4a19-809b-e4cda4a59c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe75ec9-7e71-4a19-809b-e4cda4a59c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '464f0b6d-49ed-4340-8390-246017f5223a', 'volume_name': 'volume-464f0b6d-49ed-4340-8390-246017f5223a', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8490862-ff76-4bca-88f5-2da9c1a22dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8490862-ff76-4bca-88f5-2da9c1a22dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:30:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bbb0754-0ee8-49d4-af12-e44372c9a52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:30:52 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Volume 464f0b6d-49ed-4340-8390-246017f5223a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-464f0b6d-49ed-4340-8390-246017f5223a', 'volume_size': 1} Jul 07 17:30:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:52 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af" returned: 0 in 1.215s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:52 devstack cinder-volume[87303]: DEBUG cinder.utils [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Path /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b8105903-c791-48bc-80df-f164db103602 not found in is_blk_device check {{(pid=87303) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:30:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b8105903-c791-48bc-80df-f164db103602 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:52 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b8105903-c791-48bc-80df-f164db103602 Jul 07 17:30:52 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:30:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:30:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:30:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:30:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:30:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:30:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:56 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:30:56 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:30:58 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.841s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:58 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:30:58 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:30:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:30:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:30:58 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Jul 07 17:30:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b8105903-c791-48bc-80df-f164db103602" returned: 0 in 6.141s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:30:58 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe57f478-2baa-4338-8c9a-d947e56c6924]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:30:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:30:59 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af Jul 07 17:30:59 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:00 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af" returned: 0 in 1.178s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:00 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Image conversion details: src /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b8105903-c791-48bc-80df-f164db103602 {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:31:00 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Converted 1024.00 MB image at 166.72 MB/s Jul 07 17:31:00 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b8105903-c791-48bc-80df-f164db103602 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:31:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b8105903-c791-48bc-80df-f164db103602 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:00 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b8105903-c791-48bc-80df-f164db103602 Jul 07 17:31:00 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:00 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b8105903-c791-48bc-80df-f164db103602" returned: 0 in 0.896s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:00 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-b8105903-c791-48bc-80df-f164db103602" released by "_copy_volume_from_snapshot" :: held 10.505s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-bcfa9fe5-6883-4efe-8eda-c4bce70399ec-b8105903-c791-48bc-80df-f164db103602" released by "_create_volume_from_snapshot" :: held 10.558s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.581s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-64bbd54e-53ca-441e-8008-5ae5e977b72b req-410979c4-d339-4a30-b0ed-1ec0da378c97 tempest-TestStampPattern-407190565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.874s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03154fa-da9c-4aca-8a7c-b7494101a6a7]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-64bbd54e-53ca-441e-8008-5ae5e977b72b req-410979c4-d339-4a30-b0ed-1ec0da378c97 tempest-TestStampPattern-407190565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:01 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-85ea697a-9993-4edb-9ad2-00cd675cb83d tempest-GroupSnapshotsTest-1684738746 None] Create group from source-snapshot-30edb2cf-809a-4382-9954-758b7eb3fd2e completed successfully. Jul 07 17:31:01 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 Jul 07 17:31:01 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Flow 'volume_create_manager' (8e24a30b-6cfd-466c-a5d0-1dc3c976ebff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a81631-6d60-4b79-8898-d74ea98edf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a81631-6d60-4b79-8898-d74ea98edf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1712235405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41043c6f-1330-4d24-9261-0f0a9a449482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09e1450f6e446819b67d156ade7c1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:02Z,use_quota=True,user_id='e7c04576a4ca44b1aaa29659baa6bdd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3beb13d8-3bbe-4c31-9179-f9590410793e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3beb13d8-3bbe-4c31-9179-f9590410793e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d3da98d-e56a-4368-a3a4-d99042ed034e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d3da98d-e56a-4368-a3a4-d99042ed034e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41043c6f-1330-4d24-9261-0f0a9a449482', 'volume_name': 'volume-41043c6f-1330-4d24-9261-0f0a9a449482', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7e88a4-1a1a-411e-8e8c-e503de03be79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7e88a4-1a1a-411e-8e8c-e503de03be79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1dd4431-e13f-4752-a3ff-f56a428a0526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:01 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Volume 41043c6f-1330-4d24-9261-0f0a9a449482: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41043c6f-1330-4d24-9261-0f0a9a449482', 'volume_size': 1} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:01 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-64bbd54e-53ca-441e-8008-5ae5e977b72b req-410979c4-d339-4a30-b0ed-1ec0da378c97 tempest-TestStampPattern-407190565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6" returned: 0 in 0.913s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-64bbd54e-53ca-441e-8008-5ae5e977b72b req-410979c4-d339-4a30-b0ed-1ec0da378c97 tempest-TestStampPattern-407190565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.932s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.512s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-667751813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=464f0b6d-49ed-4340-8390-246017f5223a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c9ee5a20604fca96cef18937ba2b84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:30:52Z,use_quota=True,user_id='372d25c33889456499097346e1a8c3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Creating volume 464f0b6d-49ed-4340-8390-246017f5223a {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:31:01 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:31:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-464f0b6d-49ed-4340-8390-246017f5223a 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:01 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-464f0b6d-49ed-4340-8390-246017f5223a 1073741824 Jul 07 17:31:01 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-64bbd54e-53ca-441e-8008-5ae5e977b72b req-410979c4-d339-4a30-b0ed-1ec0da378c97 tempest-TestStampPattern-407190565 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2', 'name': 'volume-38e9342c-3870-4c66-bb34-7d85667ab9f6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a3e4d97-4223-4681-b166-9dc36d373148', 'enforce_multipath': True} {{(pid=87303) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:31:02 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-64bbd54e-53ca-441e-8008-5ae5e977b72b req-410979c4-d339-4a30-b0ed-1ec0da378c97 tempest-TestStampPattern-407190565 None] attachment_update completed successfully. Jul 07 17:31:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0983f60f-08eb-4957-bfd5-e729d6b8564b tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "cinder-quobyte-b8105903-c791-48bc-80df-f164db103602" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0983f60f-08eb-4957-bfd5-e729d6b8564b tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-b8105903-c791-48bc-80df-f164db103602" acquired by "delete_volume" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:02 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d254ca4c-3e74-4761-8a07-c6da0ae91d3c]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0983f60f-08eb-4957-bfd5-e729d6b8564b tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b8105903-c791-48bc-80df-f164db103602 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:02 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b8105903-c791-48bc-80df-f164db103602 Jul 07 17:31:02 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:02 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-464f0b6d-49ed-4340-8390-246017f5223a 1073741824" returned: 0 in 1.017s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-464f0b6d-49ed-4340-8390-246017f5223a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:03 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-464f0b6d-49ed-4340-8390-246017f5223a Jul 07 17:31:03 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:03 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0983f60f-08eb-4957-bfd5-e729d6b8564b tempest-GroupSnapshotsTest-1684738746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b8105903-c791-48bc-80df-f164db103602" returned: 0 in 0.991s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0983f60f-08eb-4957-bfd5-e729d6b8564b tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b8105903-c791-48bc-80df-f164db103602 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:03 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b8105903-c791-48bc-80df-f164db103602 Jul 07 17:31:03 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:03 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-464f0b6d-49ed-4340-8390-246017f5223a" returned: 0 in 0.802s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:03 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:31:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.993s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:03 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1712235405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41043c6f-1330-4d24-9261-0f0a9a449482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09e1450f6e446819b67d156ade7c1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:02Z,use_quota=True,user_id='e7c04576a4ca44b1aaa29659baa6bdd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:31:03 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Creating volume 41043c6f-1330-4d24-9261-0f0a9a449482 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:31:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:03 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:03 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:03 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:31:03 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:31:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:03 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482 1073741824 Jul 07 17:31:03 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:03 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bbb0754-0ee8-49d4-af12-e44372c9a52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-464f0b6d-49ed-4340-8390-246017f5223a', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:03 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8df36bb-230b-4072-86f1-a4948ecb5727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:03 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Volume volume-464f0b6d-49ed-4340-8390-246017f5223a (464f0b6d-49ed-4340-8390-246017f5223a): created successfully Jul 07 17:31:03 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8df36bb-230b-4072-86f1-a4948ecb5727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:03 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Flow 'volume_create_manager' (78eab3a7-4e4e-4cf0-8432-d3d23fde0738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:03 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-f7eca8a8-3482-4e75-be2f-8240cc50fd7b tempest-VolumesTransfersTest-1400621768 None] Created volume successfully. Jul 07 17:31:04 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0983f60f-08eb-4957-bfd5-e729d6b8564b tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b8105903-c791-48bc-80df-f164db103602" returned: 0 in 0.780s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:04 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0983f60f-08eb-4957-bfd5-e729d6b8564b tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-b8105903-c791-48bc-80df-f164db103602" released by "delete_volume" :: held 1.827s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:04 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-0983f60f-08eb-4957-bfd5-e729d6b8564b tempest-GroupSnapshotsTest-1684738746 None] Created reservations ['79bc756b-80a9-41d4-8e45-7c5f658a390d'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:04 devstack cinder-volume[87303]: WARNING cinder.quota [None req-0983f60f-08eb-4957-bfd5-e729d6b8564b tempest-GroupSnapshotsTest-1684738746 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-600048864 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-600048864, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:31:04 devstack cinder-volume[87303]: WARNING cinder.quota [None req-0983f60f-08eb-4957-bfd5-e729d6b8564b tempest-GroupSnapshotsTest-1684738746 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-600048864 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-600048864, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:31:04 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-0983f60f-08eb-4957-bfd5-e729d6b8564b tempest-GroupSnapshotsTest-1684738746 None] Created reservations ['93450de7-3da1-48d2-87dd-247999d50e56', 'd74df852-0ed4-49e5-b628-d1d7c7b18712', '61598dd1-6299-4d78-bc3a-dd8ad51535ff', '25146d7d-ddad-4b3a-a4a8-b38c9ae2b32a'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:04 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:UPDATE=119,cinder:DELETE=9,cinder:SELECT=100,cinder:INSERT=19 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:31:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0983f60f-08eb-4957-bfd5-e729d6b8564b tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0983f60f-08eb-4957-bfd5-e729d6b8564b tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0983f60f-08eb-4957-bfd5-e729d6b8564b tempest-GroupSnapshotsTest-1684738746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0983f60f-08eb-4957-bfd5-e729d6b8564b tempest-GroupSnapshotsTest-1684738746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0983f60f-08eb-4957-bfd5-e729d6b8564b tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0983f60f-08eb-4957-bfd5-e729d6b8564b tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:04 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:31:04 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:04 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-53e926aa-f280-4f0f-8e7a-2b5a9f6d768a tempest-GroupSnapshotsTest-1684738746 None] group_snapshot 30edb2cf-809a-4382-9954-758b7eb3fd2e: deleting Jul 07 17:31:04 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-6c66774c-e1bd-40d4-894d-5af93a993806 tempest-VolumesTransfersTest-1544906212 None] Transfer volume completed successfully. Jul 07 17:31:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-53e926aa-f280-4f0f-8e7a-2b5a9f6d768a tempest-GroupSnapshotsTest-1684738746 None] group_snapshot 30edb2cf-809a-4382-9954-758b7eb3fd2e: deleting {{(pid=87303) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 17:31:05 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-53e926aa-f280-4f0f-8e7a-2b5a9f6d768a tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "cinder-quobyte-7ca1c75d-a863-4016-a605-119cce60d8af" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:05 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-53e926aa-f280-4f0f-8e7a-2b5a9f6d768a tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-7ca1c75d-a863-4016-a605-119cce60d8af" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:05 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-53e926aa-f280-4f0f-8e7a-2b5a9f6d768a tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "cinder-quobyte-bcfa9fe5-6883-4efe-8eda-c4bce70399ec" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:05 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-53e926aa-f280-4f0f-8e7a-2b5a9f6d768a tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-bcfa9fe5-6883-4efe-8eda-c4bce70399ec" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-53e926aa-f280-4f0f-8e7a-2b5a9f6d768a tempest-GroupSnapshotsTest-1684738746 None] Deleting offline snapshot bcfa9fe5-6883-4efe-8eda-c4bce70399ec of volume 7ca1c75d-a863-4016-a605-119cce60d8af {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:31:05 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-53e926aa-f280-4f0f-8e7a-2b5a9f6d768a tempest-GroupSnapshotsTest-1684738746 None] snapshot_file for this snap is: volume-7ca1c75d-a863-4016-a605-119cce60d8af.bcfa9fe5-6883-4efe-8eda-c4bce70399ec {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:31:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482 1073741824" returned: 0 in 1.235s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:05 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c2cda6-6e3c-4ebf-b7da-8cbc0a835077]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-53e926aa-f280-4f0f-8e7a-2b5a9f6d768a tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.bcfa9fe5-6883-4efe-8eda-c4bce70399ec {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:05 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482 Jul 07 17:31:05 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:05 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.bcfa9fe5-6883-4efe-8eda-c4bce70399ec Jul 07 17:31:05 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:05 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0983f60f-08eb-4957-bfd5-e729d6b8564b tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.840s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:05 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-0983f60f-08eb-4957-bfd5-e729d6b8564b tempest-GroupSnapshotsTest-1684738746 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:05 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-0983f60f-08eb-4957-bfd5-e729d6b8564b tempest-GroupSnapshotsTest-1684738746 None] Delete group completed successfully. Jul 07 17:31:06 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482" returned: 0 in 0.955s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] <== create_volume: return (2260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:31:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.263s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1dd4431-e13f-4752-a3ff-f56a428a0526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41043c6f-1330-4d24-9261-0f0a9a449482', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0c75ad-781e-4699-9931-fe4f3445fb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:06 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Volume volume-41043c6f-1330-4d24-9261-0f0a9a449482 (41043c6f-1330-4d24-9261-0f0a9a449482): created successfully Jul 07 17:31:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0c75ad-781e-4699-9931-fe4f3445fb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Flow 'volume_create_manager' (8e24a30b-6cfd-466c-a5d0-1dc3c976ebff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9865da51-32b7-44ba-a740-0c496484592a tempest-VolumesTransfersTest-1050056706 None] Acquiring lock "cinder-464f0b6d-49ed-4340-8390-246017f5223a-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:06 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-3e17fed4-5a1b-4437-b78b-37ebb440f015 tempest-SnapshotDependencyTests-789385698 None] Created volume successfully. Jul 07 17:31:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9865da51-32b7-44ba-a740-0c496484592a tempest-VolumesTransfersTest-1050056706 None] Lock "cinder-464f0b6d-49ed-4340-8390-246017f5223a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9865da51-32b7-44ba-a740-0c496484592a tempest-VolumesTransfersTest-1050056706 None] Acquiring lock "cinder-quobyte-464f0b6d-49ed-4340-8390-246017f5223a" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9865da51-32b7-44ba-a740-0c496484592a tempest-VolumesTransfersTest-1050056706 None] Lock "cinder-quobyte-464f0b6d-49ed-4340-8390-246017f5223a" acquired by "delete_volume" :: waited 0.028s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:06 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded507fa-b790-46f4-8286-ce631498f3e3]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9865da51-32b7-44ba-a740-0c496484592a tempest-VolumesTransfersTest-1050056706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-464f0b6d-49ed-4340-8390-246017f5223a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:06 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-53e926aa-f280-4f0f-8e7a-2b5a9f6d768a tempest-GroupSnapshotsTest-1684738746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.bcfa9fe5-6883-4efe-8eda-c4bce70399ec" returned: 0 in 1.329s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-53e926aa-f280-4f0f-8e7a-2b5a9f6d768a tempest-GroupSnapshotsTest-1684738746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ca1c75d-a863-4016-a605-119cce60d8af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:31:06 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d027f0-a1f0-4f81-b708-69aedc6dfbb4]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-53e926aa-f280-4f0f-8e7a-2b5a9f6d768a tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:06 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-464f0b6d-49ed-4340-8390-246017f5223a Jul 07 17:31:06 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:06 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af Jul 07 17:31:06 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-531a8f92-9852-48f3-bff5-8c3aba60bbb1 tempest-SnapshotDependencyTests-789385698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-531a8f92-9852-48f3-bff5-8c3aba60bbb1 tempest-SnapshotDependencyTests-789385698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-531a8f92-9852-48f3-bff5-8c3aba60bbb1 tempest-SnapshotDependencyTests-789385698 None] Creating offline snapshot 7a6358cb-2919-4705-a4e8-4761383c15d5 of volume 41043c6f-1330-4d24-9261-0f0a9a449482 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:31:06 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8d2b4b-ebe9-4236-aba6-18e13e77da9d]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-531a8f92-9852-48f3-bff5-8c3aba60bbb1 tempest-SnapshotDependencyTests-789385698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:06 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482 Jul 07 17:31:06 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:07 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9865da51-32b7-44ba-a740-0c496484592a tempest-VolumesTransfersTest-1050056706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-464f0b6d-49ed-4340-8390-246017f5223a" returned: 0 in 0.977s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9865da51-32b7-44ba-a740-0c496484592a tempest-VolumesTransfersTest-1050056706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-464f0b6d-49ed-4340-8390-246017f5223a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:07 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-464f0b6d-49ed-4340-8390-246017f5223a Jul 07 17:31:07 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:07 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-53e926aa-f280-4f0f-8e7a-2b5a9f6d768a tempest-GroupSnapshotsTest-1684738746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af" returned: 0 in 1.071s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-53e926aa-f280-4f0f-8e7a-2b5a9f6d768a tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.bcfa9fe5-6883-4efe-8eda-c4bce70399ec {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:07 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.bcfa9fe5-6883-4efe-8eda-c4bce70399ec Jul 07 17:31:07 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:07 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-531a8f92-9852-48f3-bff5-8c3aba60bbb1 tempest-SnapshotDependencyTests-789385698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482" returned: 0 in 0.947s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-531a8f92-9852-48f3-bff5-8c3aba60bbb1 tempest-SnapshotDependencyTests-789385698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.7a6358cb-2919-4705-a4e8-4761383c15d5 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:07 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.7a6358cb-2919-4705-a4e8-4761383c15d5 1G Jul 07 17:31:07 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:08 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9865da51-32b7-44ba-a740-0c496484592a tempest-VolumesTransfersTest-1050056706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-464f0b6d-49ed-4340-8390-246017f5223a" returned: 0 in 0.839s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9865da51-32b7-44ba-a740-0c496484592a tempest-VolumesTransfersTest-1050056706 None] Lock "cinder-quobyte-464f0b6d-49ed-4340-8390-246017f5223a" released by "delete_volume" :: held 1.895s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:08 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-9865da51-32b7-44ba-a740-0c496484592a tempest-VolumesTransfersTest-1050056706 None] Created reservations ['e568f1ca-75d1-4e28-97ea-c5575d6daeb2', '7a546196-7371-4b7c-ac81-523950bd096c', 'ee465e2e-a160-4f2f-b4b6-07a4c6d30070', '0f7a9997-290c-4e77-b601-f4ab1af34cc5'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9865da51-32b7-44ba-a740-0c496484592a tempest-VolumesTransfersTest-1050056706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9865da51-32b7-44ba-a740-0c496484592a tempest-VolumesTransfersTest-1050056706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9865da51-32b7-44ba-a740-0c496484592a tempest-VolumesTransfersTest-1050056706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9865da51-32b7-44ba-a740-0c496484592a tempest-VolumesTransfersTest-1050056706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9865da51-32b7-44ba-a740-0c496484592a tempest-VolumesTransfersTest-1050056706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9865da51-32b7-44ba-a740-0c496484592a tempest-VolumesTransfersTest-1050056706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:08 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:08 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:31:08 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-53e926aa-f280-4f0f-8e7a-2b5a9f6d768a tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.bcfa9fe5-6883-4efe-8eda-c4bce70399ec" returned: 0 in 0.907s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-53e926aa-f280-4f0f-8e7a-2b5a9f6d768a tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.bcfa9fe5-6883-4efe-8eda-c4bce70399ec {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:08 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.bcfa9fe5-6883-4efe-8eda-c4bce70399ec Jul 07 17:31:08 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:08 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-531a8f92-9852-48f3-bff5-8c3aba60bbb1 tempest-SnapshotDependencyTests-789385698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.7a6358cb-2919-4705-a4e8-4761383c15d5 1G" returned: 0 in 1.199s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-531a8f92-9852-48f3-bff5-8c3aba60bbb1 tempest-SnapshotDependencyTests-789385698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41043c6f-1330-4d24-9261-0f0a9a449482 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.7a6358cb-2919-4705-a4e8-4761383c15d5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:08 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41043c6f-1330-4d24-9261-0f0a9a449482 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.7a6358cb-2919-4705-a4e8-4761383c15d5 Jul 07 17:31:08 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:09 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:31:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Flow 'volume_create_manager' (e44b2be9-9eff-41d5-b539-96f4f22f6cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6363ffa2-4fe7-4469-98fa-fb9fee0a5d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6363ffa2-4fe7-4469-98fa-fb9fee0a5d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1734631273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e60d8dd7-5f8c-4f38-9a19-82338975cec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c9ee5a20604fca96cef18937ba2b84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:09Z,use_quota=True,user_id='372d25c33889456499097346e1a8c3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a0a807-7788-4aa6-9516-9bb02c816b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a0a807-7788-4aa6-9516-9bb02c816b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2384d1d0-56fe-4328-bda0-b29081c8e1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2384d1d0-56fe-4328-bda0-b29081c8e1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e60d8dd7-5f8c-4f38-9a19-82338975cec9', 'volume_name': 'volume-e60d8dd7-5f8c-4f38-9a19-82338975cec9', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9121f9-66e0-43d5-87ce-6d6cdd70b50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9121f9-66e0-43d5-87ce-6d6cdd70b50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ddd98cf-73b3-44c5-8e29-bc36ac61aa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:09 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Volume e60d8dd7-5f8c-4f38-9a19-82338975cec9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e60d8dd7-5f8c-4f38-9a19-82338975cec9', 'volume_size': 1} Jul 07 17:31:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:09 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9865da51-32b7-44ba-a740-0c496484592a tempest-VolumesTransfersTest-1050056706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.105s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:09 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-9865da51-32b7-44ba-a740-0c496484592a tempest-VolumesTransfersTest-1050056706 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:09 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-9865da51-32b7-44ba-a740-0c496484592a tempest-VolumesTransfersTest-1050056706 None] Deleted volume successfully. Jul 07 17:31:09 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9865da51-32b7-44ba-a740-0c496484592a tempest-VolumesTransfersTest-1050056706 None] Lock "cinder-464f0b6d-49ed-4340-8390-246017f5223a-delete_volume" released by "delete_volume" :: held 3.324s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:09 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-53e926aa-f280-4f0f-8e7a-2b5a9f6d768a tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af.bcfa9fe5-6883-4efe-8eda-c4bce70399ec" returned: 0 in 1.130s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:09 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-53e926aa-f280-4f0f-8e7a-2b5a9f6d768a tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-bcfa9fe5-6883-4efe-8eda-c4bce70399ec" released by "_delete_snapshot" :: held 4.584s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:09 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-53e926aa-f280-4f0f-8e7a-2b5a9f6d768a tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-7ca1c75d-a863-4016-a605-119cce60d8af" released by "delete_snapshot" :: held 4.612s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:09 devstack cinder-volume[87303]: WARNING cinder.quota [None req-53e926aa-f280-4f0f-8e7a-2b5a9f6d768a tempest-GroupSnapshotsTest-1684738746 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-600048864 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-600048864, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:31:09 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-53e926aa-f280-4f0f-8e7a-2b5a9f6d768a tempest-GroupSnapshotsTest-1684738746 None] Created reservations ['7cff2a39-566d-4847-a268-bdc0a9fd4bc6', '69a45aa0-a071-4754-a4d4-bb70b0836ec1', '2b91f131-90ad-4622-8251-af5bce4b7554', '319dc042-260b-48c4-a25a-fc73d7abf00a'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:09 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-53e926aa-f280-4f0f-8e7a-2b5a9f6d768a tempest-GroupSnapshotsTest-1684738746 None] group_snapshot 30edb2cf-809a-4382-9954-758b7eb3fd2e: deleted successfully Jul 07 17:31:09 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-531a8f92-9852-48f3-bff5-8c3aba60bbb1 tempest-SnapshotDependencyTests-789385698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41043c6f-1330-4d24-9261-0f0a9a449482 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.7a6358cb-2919-4705-a4e8-4761383c15d5" returned: 0 in 1.038s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:09 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-531a8f92-9852-48f3-bff5-8c3aba60bbb1 tempest-SnapshotDependencyTests-789385698 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.7a6358cb-2919-4705-a4e8-4761383c15d5 is being set with open permissions: ugo+rw Jul 07 17:31:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-531a8f92-9852-48f3-bff5-8c3aba60bbb1 tempest-SnapshotDependencyTests-789385698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.7a6358cb-2919-4705-a4e8-4761383c15d5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:09 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.7a6358cb-2919-4705-a4e8-4761383c15d5 Jul 07 17:31:09 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:10 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-531a8f92-9852-48f3-bff5-8c3aba60bbb1 tempest-SnapshotDependencyTests-789385698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.7a6358cb-2919-4705-a4e8-4761383c15d5" returned: 0 in 0.718s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-531a8f92-9852-48f3-bff5-8c3aba60bbb1 tempest-SnapshotDependencyTests-789385698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:10 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.info Jul 07 17:31:10 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9638c3ec-8806-4cbf-8e76-6293c1b9a0b5 tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "cinder-quobyte-7ca1c75d-a863-4016-a605-119cce60d8af" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9638c3ec-8806-4cbf-8e76-6293c1b9a0b5 tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-7ca1c75d-a863-4016-a605-119cce60d8af" acquired by "delete_volume" :: waited 0.016s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:10 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c66d5e-31ea-4d71-a77b-658a35a55294]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9638c3ec-8806-4cbf-8e76-6293c1b9a0b5 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:11 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af Jul 07 17:31:11 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:11 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-931b3c96-325c-4575-af28-9d57559bad7f req-4ef2cda4-6498-46cd-a12e-496650d42d47 tempest-TestStampPattern-407190565 None] Terminate volume connection completed successfully. Jul 07 17:31:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-931b3c96-325c-4575-af28-9d57559bad7f req-4ef2cda4-6498-46cd-a12e-496650d42d47 tempest-TestStampPattern-407190565 None] Deleting attachment 4a3e4d97-4223-4681-b166-9dc36d373148. {{(pid=87303) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:31:11 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-531a8f92-9852-48f3-bff5-8c3aba60bbb1 tempest-SnapshotDependencyTests-789385698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.info" returned: 0 in 0.788s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:11 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-531a8f92-9852-48f3-bff5-8c3aba60bbb1 tempest-SnapshotDependencyTests-789385698 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.info is being set with open permissions: ugo+rw Jul 07 17:31:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-531a8f92-9852-48f3-bff5-8c3aba60bbb1 tempest-SnapshotDependencyTests-789385698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:11 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.info Jul 07 17:31:11 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:11 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9638c3ec-8806-4cbf-8e76-6293c1b9a0b5 tempest-GroupSnapshotsTest-1684738746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af" returned: 0 in 0.903s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9638c3ec-8806-4cbf-8e76-6293c1b9a0b5 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:11 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af Jul 07 17:31:11 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:12 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-531a8f92-9852-48f3-bff5-8c3aba60bbb1 tempest-SnapshotDependencyTests-789385698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.info" returned: 0 in 0.781s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-531a8f92-9852-48f3-bff5-8c3aba60bbb1 tempest-SnapshotDependencyTests-789385698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.582s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.820s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1734631273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e60d8dd7-5f8c-4f38-9a19-82338975cec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c9ee5a20604fca96cef18937ba2b84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:09Z,use_quota=True,user_id='372d25c33889456499097346e1a8c3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:31:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Creating volume e60d8dd7-5f8c-4f38-9a19-82338975cec9 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:31:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:31:12 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:31:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e60d8dd7-5f8c-4f38-9a19-82338975cec9 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:12 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e60d8dd7-5f8c-4f38-9a19-82338975cec9 1073741824 Jul 07 17:31:12 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:12 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-531a8f92-9852-48f3-bff5-8c3aba60bbb1 tempest-SnapshotDependencyTests-789385698 None] Create snapshot completed successfully Jul 07 17:31:12 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9638c3ec-8806-4cbf-8e76-6293c1b9a0b5 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7ca1c75d-a863-4016-a605-119cce60d8af" returned: 0 in 0.781s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:12 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9638c3ec-8806-4cbf-8e76-6293c1b9a0b5 tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-7ca1c75d-a863-4016-a605-119cce60d8af" released by "delete_volume" :: held 1.764s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:12 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-9638c3ec-8806-4cbf-8e76-6293c1b9a0b5 tempest-GroupSnapshotsTest-1684738746 None] Created reservations ['56a22d3b-1fa2-49da-9fde-7b9114c6bec7'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:12 devstack cinder-volume[87303]: WARNING cinder.db.api [None req-9638c3ec-8806-4cbf-8e76-6293c1b9a0b5 tempest-GroupSnapshotsTest-1684738746 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-600048864'] Jul 07 17:31:12 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-9638c3ec-8806-4cbf-8e76-6293c1b9a0b5 tempest-GroupSnapshotsTest-1684738746 None] Created reservations ['dd65d9a4-aa4e-4067-87d1-f51894be7bbb', 'e22eb047-1f37-4217-a407-3178e5bbc4e6', 'b3fab15c-1413-4b65-9d99-5b2377681036', '3f0fa4ae-9478-4795-ac9a-0009dbd0f8e2'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9638c3ec-8806-4cbf-8e76-6293c1b9a0b5 tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9638c3ec-8806-4cbf-8e76-6293c1b9a0b5 tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9638c3ec-8806-4cbf-8e76-6293c1b9a0b5 tempest-GroupSnapshotsTest-1684738746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9638c3ec-8806-4cbf-8e76-6293c1b9a0b5 tempest-GroupSnapshotsTest-1684738746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9638c3ec-8806-4cbf-8e76-6293c1b9a0b5 tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9638c3ec-8806-4cbf-8e76-6293c1b9a0b5 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:12 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:31:12 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:13 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e60d8dd7-5f8c-4f38-9a19-82338975cec9 1073741824" returned: 0 in 1.202s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e60d8dd7-5f8c-4f38-9a19-82338975cec9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:13 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e60d8dd7-5f8c-4f38-9a19-82338975cec9 Jul 07 17:31:13 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dc98c31c-cac5-490a-986d-62b65a173f2d tempest-TestStampPattern-407190565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:13 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9638c3ec-8806-4cbf-8e76-6293c1b9a0b5 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.058s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:13 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-9638c3ec-8806-4cbf-8e76-6293c1b9a0b5 tempest-GroupSnapshotsTest-1684738746 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:13 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-9638c3ec-8806-4cbf-8e76-6293c1b9a0b5 tempest-GroupSnapshotsTest-1684738746 None] Delete group completed successfully. Jul 07 17:31:14 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:31:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Flow 'volume_create_manager' (96102013-8778-49b4-a912-77735642c66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f0579c-689c-4531-b6c9-65cd414bb210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f0579c-689c-4531-b6c9-65cd414bb210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f890997-e1b1-48e6-84d8-fbdca3efb17f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09e1450f6e446819b67d156ade7c1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7a6358cb-2919-4705-a4e8-4761383c15d5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:14Z,use_quota=True,user_id='e7c04576a4ca44b1aaa29659baa6bdd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4cbc4a3-d2db-4150-a215-8e9571fec0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4cbc4a3-d2db-4150-a215-8e9571fec0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287dc529-866b-4174-b43a-ff9bedda3b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287dc529-866b-4174-b43a-ff9bedda3b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8f890997-e1b1-48e6-84d8-fbdca3efb17f', 'volume_name': 'volume-8f890997-e1b1-48e6-84d8-fbdca3efb17f', 'volume_size': 1, 'snapshot_id': '7a6358cb-2919-4705-a4e8-4761383c15d5'}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f28b0a5-825f-4c9c-a3b6-583788b0368c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f28b0a5-825f-4c9c-a3b6-583788b0368c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02fa32d0-1803-419e-8166-fc252f3a5241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:14 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Volume 8f890997-e1b1-48e6-84d8-fbdca3efb17f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8f890997-e1b1-48e6-84d8-fbdca3efb17f', 'volume_size': 1, 'snapshot_id': '7a6358cb-2919-4705-a4e8-4761383c15d5'} Jul 07 17:31:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:14 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5d32efb4-2520-4eb3-be18-df0a679a2fb6 tempest-GroupSnapshotsTest-1684738746 None] Group tempest-GroupSnapshotsTest-Group-1413108458: creating Jul 07 17:31:14 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5d32efb4-2520-4eb3-be18-df0a679a2fb6 tempest-GroupSnapshotsTest-1684738746 None] Group tempest-GroupSnapshotsTest-Group-1413108458: created successfully Jul 07 17:31:14 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5d32efb4-2520-4eb3-be18-df0a679a2fb6 tempest-GroupSnapshotsTest-1684738746 None] Create group completed successfully. Jul 07 17:31:14 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e60d8dd7-5f8c-4f38-9a19-82338975cec9" returned: 0 in 1.042s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] <== create_volume: return (2320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:31:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.324s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dc98c31c-cac5-490a-986d-62b65a173f2d tempest-TestStampPattern-407190565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.928s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ddd98cf-73b3-44c5-8e29-bc36ac61aa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e60d8dd7-5f8c-4f38-9a19-82338975cec9', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5663ddc-fdee-4f5b-90c1-6a4c7ece7c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-dc98c31c-cac5-490a-986d-62b65a173f2d tempest-TestStampPattern-407190565 None] Creating offline snapshot 02389c7b-b92b-44ac-8825-0e1f5ae0c1ba of volume 38e9342c-3870-4c66-bb34-7d85667ab9f6 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:31:14 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Volume volume-e60d8dd7-5f8c-4f38-9a19-82338975cec9 (e60d8dd7-5f8c-4f38-9a19-82338975cec9): created successfully Jul 07 17:31:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5663ddc-fdee-4f5b-90c1-6a4c7ece7c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Flow 'volume_create_manager' (e44b2be9-9eff-41d5-b539-96f4f22f6cb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:14 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c09cd1-558f-4f96-a770-3f862f457130]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dc98c31c-cac5-490a-986d-62b65a173f2d tempest-TestStampPattern-407190565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:14 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-13494f30-5d2c-449c-9571-1dc02ffa3c68 tempest-VolumesTransfersTest-1400621768 None] Created volume successfully. Jul 07 17:31:14 devstack sudo[99788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 Jul 07 17:31:14 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f78907a5-e5d0-4338-bf2d-7fa4df44752d tempest-VolumesTransfersTest-1050056706 None] Acquiring lock "cinder-e60d8dd7-5f8c-4f38-9a19-82338975cec9-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f78907a5-e5d0-4338-bf2d-7fa4df44752d tempest-VolumesTransfersTest-1050056706 None] Lock "cinder-e60d8dd7-5f8c-4f38-9a19-82338975cec9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f78907a5-e5d0-4338-bf2d-7fa4df44752d tempest-VolumesTransfersTest-1050056706 None] Acquiring lock "cinder-quobyte-e60d8dd7-5f8c-4f38-9a19-82338975cec9" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f78907a5-e5d0-4338-bf2d-7fa4df44752d tempest-VolumesTransfersTest-1050056706 None] Lock "cinder-quobyte-e60d8dd7-5f8c-4f38-9a19-82338975cec9" acquired by "delete_volume" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:15 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bad666d-c21e-40aa-b970-22f0aa160f4b]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f78907a5-e5d0-4338-bf2d-7fa4df44752d tempest-VolumesTransfersTest-1050056706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e60d8dd7-5f8c-4f38-9a19-82338975cec9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:15 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dc98c31c-cac5-490a-986d-62b65a173f2d tempest-TestStampPattern-407190565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6" returned: 0 in 0.918s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dc98c31c-cac5-490a-986d-62b65a173f2d tempest-TestStampPattern-407190565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.02389c7b-b92b-44ac-8825-0e1f5ae0c1ba 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:15 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e60d8dd7-5f8c-4f38-9a19-82338975cec9 Jul 07 17:31:15 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:15 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.02389c7b-b92b-44ac-8825-0e1f5ae0c1ba 1G Jul 07 17:31:15 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:16 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:31:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Flow 'volume_create_manager' (5106fb96-578a-46fa-b877-5f313cbde333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f8a19d3-7bd2-4ee5-97e2-b4d76128b292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f8a19d3-7bd2-4ee5-97e2-b4d76128b292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1402540630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=acff8dbc-b82c-4fc5-9aef-1f1a03edf5b4,host='devstack@QuobyteHD#QuobyteHD',id=5b01230d-92cd-42b6-bcd4-440b1165d762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bf690e56ad4cac825da95f67d485ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:16Z,use_quota=True,user_id='c66f97be2ff945cd87f6359c4986d156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39bc6039-0c0e-4e35-bcdc-1be24b599b11),volume_type_id=39bc6039-0c0e-4e35-bcdc-1be24b599b11)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b6b5cf-cda9-405f-a46c-6a70d729b831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b6b5cf-cda9-405f-a46c-6a70d729b831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d58ecc-60ac-486d-9dcc-6f2ec9e53c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d58ecc-60ac-486d-9dcc-6f2ec9e53c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b01230d-92cd-42b6-bcd4-440b1165d762', 'volume_name': 'volume-5b01230d-92cd-42b6-bcd4-440b1165d762', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f8ff6c-e8b0-4b76-9dfe-738f535375d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f8ff6c-e8b0-4b76-9dfe-738f535375d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a47391-c854-4106-9bee-e1e6ea06aecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:16 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Volume 5b01230d-92cd-42b6-bcd4-440b1165d762: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b01230d-92cd-42b6-bcd4-440b1165d762', 'volume_size': 1} Jul 07 17:31:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:16 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f78907a5-e5d0-4338-bf2d-7fa4df44752d tempest-VolumesTransfersTest-1050056706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e60d8dd7-5f8c-4f38-9a19-82338975cec9" returned: 0 in 1.146s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f78907a5-e5d0-4338-bf2d-7fa4df44752d tempest-VolumesTransfersTest-1050056706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e60d8dd7-5f8c-4f38-9a19-82338975cec9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:16 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e60d8dd7-5f8c-4f38-9a19-82338975cec9 Jul 07 17:31:16 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:16 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dc98c31c-cac5-490a-986d-62b65a173f2d tempest-TestStampPattern-407190565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.02389c7b-b92b-44ac-8825-0e1f5ae0c1ba 1G" returned: 0 in 1.101s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dc98c31c-cac5-490a-986d-62b65a173f2d tempest-TestStampPattern-407190565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.02389c7b-b92b-44ac-8825-0e1f5ae0c1ba {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:16 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.02389c7b-b92b-44ac-8825-0e1f5ae0c1ba Jul 07 17:31:16 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:17 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f78907a5-e5d0-4338-bf2d-7fa4df44752d tempest-VolumesTransfersTest-1050056706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e60d8dd7-5f8c-4f38-9a19-82338975cec9" returned: 0 in 0.709s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f78907a5-e5d0-4338-bf2d-7fa4df44752d tempest-VolumesTransfersTest-1050056706 None] Lock "cinder-quobyte-e60d8dd7-5f8c-4f38-9a19-82338975cec9" released by "delete_volume" :: held 1.917s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:17 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-f78907a5-e5d0-4338-bf2d-7fa4df44752d tempest-VolumesTransfersTest-1050056706 None] Created reservations ['81d119ac-efa1-4be7-9170-a07fcf8fdb04', 'c18054b5-0d59-46bd-ba37-ec81a2fcc244', '0eddeacd-0a9b-4d15-9a9f-cc051e9492e2', '37a3925e-9290-4293-ac0e-87be0375307a'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f78907a5-e5d0-4338-bf2d-7fa4df44752d tempest-VolumesTransfersTest-1050056706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f78907a5-e5d0-4338-bf2d-7fa4df44752d tempest-VolumesTransfersTest-1050056706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f78907a5-e5d0-4338-bf2d-7fa4df44752d tempest-VolumesTransfersTest-1050056706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f78907a5-e5d0-4338-bf2d-7fa4df44752d tempest-VolumesTransfersTest-1050056706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f78907a5-e5d0-4338-bf2d-7fa4df44752d tempest-VolumesTransfersTest-1050056706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f78907a5-e5d0-4338-bf2d-7fa4df44752d tempest-VolumesTransfersTest-1050056706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:17 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:31:17 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:17 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dc98c31c-cac5-490a-986d-62b65a173f2d tempest-TestStampPattern-407190565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.02389c7b-b92b-44ac-8825-0e1f5ae0c1ba" returned: 0 in 0.899s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:17 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-dc98c31c-cac5-490a-986d-62b65a173f2d tempest-TestStampPattern-407190565 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.02389c7b-b92b-44ac-8825-0e1f5ae0c1ba is being set with open permissions: ugo+rw Jul 07 17:31:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dc98c31c-cac5-490a-986d-62b65a173f2d tempest-TestStampPattern-407190565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.02389c7b-b92b-44ac-8825-0e1f5ae0c1ba {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:17 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.02389c7b-b92b-44ac-8825-0e1f5ae0c1ba Jul 07 17:31:17 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:18 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f78907a5-e5d0-4338-bf2d-7fa4df44752d tempest-VolumesTransfersTest-1050056706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.795s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:18 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-f78907a5-e5d0-4338-bf2d-7fa4df44752d tempest-VolumesTransfersTest-1050056706 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:18 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-f78907a5-e5d0-4338-bf2d-7fa4df44752d tempest-VolumesTransfersTest-1050056706 None] Deleted volume successfully. Jul 07 17:31:18 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f78907a5-e5d0-4338-bf2d-7fa4df44752d tempest-VolumesTransfersTest-1050056706 None] Lock "cinder-e60d8dd7-5f8c-4f38-9a19-82338975cec9-delete_volume" released by "delete_volume" :: held 3.012s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:18 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dc98c31c-cac5-490a-986d-62b65a173f2d tempest-TestStampPattern-407190565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.02389c7b-b92b-44ac-8825-0e1f5ae0c1ba" returned: 0 in 0.785s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dc98c31c-cac5-490a-986d-62b65a173f2d tempest-TestStampPattern-407190565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:18 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.info Jul 07 17:31:18 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:19 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dc98c31c-cac5-490a-986d-62b65a173f2d tempest-TestStampPattern-407190565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.info" returned: 0 in 0.711s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:19 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-dc98c31c-cac5-490a-986d-62b65a173f2d tempest-TestStampPattern-407190565 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.info is being set with open permissions: ugo+rw Jul 07 17:31:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dc98c31c-cac5-490a-986d-62b65a173f2d tempest-TestStampPattern-407190565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:19 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.info Jul 07 17:31:19 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:19 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dc98c31c-cac5-490a-986d-62b65a173f2d tempest-TestStampPattern-407190565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.info" returned: 0 in 0.837s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dc98c31c-cac5-490a-986d-62b65a173f2d tempest-TestStampPattern-407190565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.383s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.819s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Acquiring lock "cinder-quobyte-7a6358cb-2919-4705-a4e8-4761383c15d5-8f890997-e1b1-48e6-84d8-fbdca3efb17f" by "_create_volume_from_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Lock "cinder-quobyte-7a6358cb-2919-4705-a4e8-4761383c15d5-8f890997-e1b1-48e6-84d8-fbdca3efb17f" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Creating volume 8f890997-e1b1-48e6-84d8-fbdca3efb17f from snapshot 7a6358cb-2919-4705-a4e8-4761383c15d5 {{(pid=87303) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:31:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:31:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Acquiring lock "cinder-quobyte-8f890997-e1b1-48e6-84d8-fbdca3efb17f" by "_copy_volume_from_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:20 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-dc98c31c-cac5-490a-986d-62b65a173f2d tempest-TestStampPattern-407190565 None] Create snapshot completed successfully Jul 07 17:31:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Lock "cinder-quobyte-8f890997-e1b1-48e6-84d8-fbdca3efb17f" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] snapshot: 7a6358cb-2919-4705-a4e8-4761383c15d5, volume: 8f890997-e1b1-48e6-84d8-fbdca3efb17f, {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:31:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:20 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae3fa12-c656-4f95-b8f6-25f9c99080f8]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.7a6358cb-2919-4705-a4e8-4761383c15d5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:20 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.7a6358cb-2919-4705-a4e8-4761383c15d5 Jul 07 17:31:20 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:21 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.7a6358cb-2919-4705-a4e8-4761383c15d5" returned: 0 in 0.873s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41043c6f-1330-4d24-9261-0f0a9a449482(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:31:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482 {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:31:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Creating direct copy from snapshot {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:31:21 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[395c0cef-2e06-4cab-87c9-39937dc451ed]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:21 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482 Jul 07 17:31:21 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:21 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482" returned: 0 in 0.904s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:21 devstack cinder-volume[87303]: DEBUG cinder.utils [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Path /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f890997-e1b1-48e6-84d8-fbdca3efb17f not found in is_blk_device check {{(pid=87303) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:31:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f890997-e1b1-48e6-84d8-fbdca3efb17f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:21 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f890997-e1b1-48e6-84d8-fbdca3efb17f Jul 07 17:31:21 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:28 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f890997-e1b1-48e6-84d8-fbdca3efb17f" returned: 0 in 6.255s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:28 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdbc4fd-4dc8-48bd-88bf-9612dc122e7b]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:28 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482 Jul 07 17:31:28 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:29 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482" returned: 0 in 1.095s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:29 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Image conversion details: src /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482, size 1024.00 MB, duration 6.26 sec, destination /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f890997-e1b1-48e6-84d8-fbdca3efb17f {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:31:29 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Converted 1024.00 MB image at 163.65 MB/s Jul 07 17:31:29 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f890997-e1b1-48e6-84d8-fbdca3efb17f is being set with open permissions: ugo+rw Jul 07 17:31:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f890997-e1b1-48e6-84d8-fbdca3efb17f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:29 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f890997-e1b1-48e6-84d8-fbdca3efb17f Jul 07 17:31:29 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:29 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:31:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Flow 'volume_create_manager' (82daa1a8-0e38-4e02-8ce3-c9c737fe17ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578b0c07-4080-45b7-a991-e6860fb4dba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578b0c07-4080-45b7-a991-e6860fb4dba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1270129030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b3ad82-f476-49a7-9cdb-9055a6647cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0feb3770aa6444a1b7619d63149f7fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:29Z,use_quota=True,user_id='867c8d8eeef34618a59ea5801589d032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f4b8a0-9f32-4710-aa2e-73332f82e362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f4b8a0-9f32-4710-aa2e-73332f82e362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1092105f-7697-43f4-961d-f7b0e06f3e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1092105f-7697-43f4-961d-f7b0e06f3e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8b3ad82-f476-49a7-9cdb-9055a6647cb5', 'volume_name': 'volume-e8b3ad82-f476-49a7-9cdb-9055a6647cb5', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f27be0e-8256-4b0d-8be7-9d79e81800f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f27be0e-8256-4b0d-8be7-9d79e81800f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb1b60d-d878-4940-a40a-729def53d403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:29 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Volume e8b3ad82-f476-49a7-9cdb-9055a6647cb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8b3ad82-f476-49a7-9cdb-9055a6647cb5', 'volume_size': 1} Jul 07 17:31:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:30 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f890997-e1b1-48e6-84d8-fbdca3efb17f" returned: 0 in 0.753s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Lock "cinder-quobyte-8f890997-e1b1-48e6-84d8-fbdca3efb17f" released by "_copy_volume_from_snapshot" :: held 10.006s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Lock "cinder-quobyte-7a6358cb-2919-4705-a4e8-4761383c15d5-8f890997-e1b1-48e6-84d8-fbdca3efb17f" released by "_create_volume_from_snapshot" :: held 10.049s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.084s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.840s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=acff8dbc-b82c-4fc5-9aef-1f1a03edf5b4,created_at=2026-07-07T15:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1402540630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=acff8dbc-b82c-4fc5-9aef-1f1a03edf5b4,host='devstack@QuobyteHD#QuobyteHD',id=5b01230d-92cd-42b6-bcd4-440b1165d762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bf690e56ad4cac825da95f67d485ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:16Z,use_quota=True,user_id='c66f97be2ff945cd87f6359c4986d156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39bc6039-0c0e-4e35-bcdc-1be24b599b11),volume_type_id=39bc6039-0c0e-4e35-bcdc-1be24b599b11)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Creating volume 5b01230d-92cd-42b6-bcd4-440b1165d762 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:31:30 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:30 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762 1073741824 Jul 07 17:31:30 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02fa32d0-1803-419e-8166-fc252f3a5241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f890997-e1b1-48e6-84d8-fbdca3efb17f', 'volume_size': 1, 'snapshot_id': '7a6358cb-2919-4705-a4e8-4761383c15d5'}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d014df3c-d20d-4396-a0ef-d2939986e78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:30 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Volume volume-8f890997-e1b1-48e6-84d8-fbdca3efb17f (8f890997-e1b1-48e6-84d8-fbdca3efb17f): created successfully Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d014df3c-d20d-4396-a0ef-d2939986e78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Flow 'volume_create_manager' (96102013-8778-49b4-a912-77735642c66e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:30 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-d18a2921-bb32-4c04-9453-2d0447c06b7b tempest-SnapshotDependencyTests-789385698 None] Created volume successfully. Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e37a8f4a-84a3-4bdf-a27f-db1db7bd237a tempest-SnapshotDependencyTests-789385698 None] Acquiring lock "cinder-7a6358cb-2919-4705-a4e8-4761383c15d5-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e37a8f4a-84a3-4bdf-a27f-db1db7bd237a tempest-SnapshotDependencyTests-789385698 None] Lock "cinder-7a6358cb-2919-4705-a4e8-4761383c15d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e37a8f4a-84a3-4bdf-a27f-db1db7bd237a tempest-SnapshotDependencyTests-789385698 None] Acquiring lock "cinder-quobyte-41043c6f-1330-4d24-9261-0f0a9a449482" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e37a8f4a-84a3-4bdf-a27f-db1db7bd237a tempest-SnapshotDependencyTests-789385698 None] Lock "cinder-quobyte-41043c6f-1330-4d24-9261-0f0a9a449482" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e37a8f4a-84a3-4bdf-a27f-db1db7bd237a tempest-SnapshotDependencyTests-789385698 None] Acquiring lock "cinder-quobyte-7a6358cb-2919-4705-a4e8-4761383c15d5" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e37a8f4a-84a3-4bdf-a27f-db1db7bd237a tempest-SnapshotDependencyTests-789385698 None] Lock "cinder-quobyte-7a6358cb-2919-4705-a4e8-4761383c15d5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e37a8f4a-84a3-4bdf-a27f-db1db7bd237a tempest-SnapshotDependencyTests-789385698 None] Deleting offline snapshot 7a6358cb-2919-4705-a4e8-4761383c15d5 of volume 41043c6f-1330-4d24-9261-0f0a9a449482 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e37a8f4a-84a3-4bdf-a27f-db1db7bd237a tempest-SnapshotDependencyTests-789385698 None] snapshot_file for this snap is: volume-41043c6f-1330-4d24-9261-0f0a9a449482.7a6358cb-2919-4705-a4e8-4761383c15d5 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[254ae28b-6b9b-407a-a29d-b8f6856d4d9d]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e37a8f4a-84a3-4bdf-a27f-db1db7bd237a tempest-SnapshotDependencyTests-789385698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.7a6358cb-2919-4705-a4e8-4761383c15d5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:30 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.7a6358cb-2919-4705-a4e8-4761383c15d5 Jul 07 17:31:30 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:31 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762 1073741824" returned: 0 in 1.088s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:31 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762 Jul 07 17:31:31 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:31 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e37a8f4a-84a3-4bdf-a27f-db1db7bd237a tempest-SnapshotDependencyTests-789385698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.7a6358cb-2919-4705-a4e8-4761383c15d5" returned: 0 in 0.921s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e37a8f4a-84a3-4bdf-a27f-db1db7bd237a tempest-SnapshotDependencyTests-789385698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41043c6f-1330-4d24-9261-0f0a9a449482(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:31:31 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[250aec02-a4b2-4601-ac80-19753aec2a70]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e37a8f4a-84a3-4bdf-a27f-db1db7bd237a tempest-SnapshotDependencyTests-789385698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:31 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482 Jul 07 17:31:31 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:32 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762" returned: 0 in 0.879s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] <== create_volume: return (2030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:31:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.034s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.652s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1270129030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b3ad82-f476-49a7-9cdb-9055a6647cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0feb3770aa6444a1b7619d63149f7fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:29Z,use_quota=True,user_id='867c8d8eeef34618a59ea5801589d032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:31:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Creating volume e8b3ad82-f476-49a7-9cdb-9055a6647cb5 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:31:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:31:32 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:31:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8b3ad82-f476-49a7-9cdb-9055a6647cb5 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:32 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8b3ad82-f476-49a7-9cdb-9055a6647cb5 1073741824 Jul 07 17:31:32 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a47391-c854-4106-9bee-e1e6ea06aecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b01230d-92cd-42b6-bcd4-440b1165d762', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (addb6fcf-6c05-4a69-867a-8c1df53912b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:32 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Volume volume-5b01230d-92cd-42b6-bcd4-440b1165d762 (5b01230d-92cd-42b6-bcd4-440b1165d762): created successfully Jul 07 17:31:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (addb6fcf-6c05-4a69-867a-8c1df53912b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Flow 'volume_create_manager' (5106fb96-578a-46fa-b877-5f313cbde333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:32 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-97dc41c2-2512-41d1-b619-09a9c0b88115 tempest-GroupSnapshotsTest-1684738746 None] Created volume successfully. Jul 07 17:31:32 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e37a8f4a-84a3-4bdf-a27f-db1db7bd237a tempest-SnapshotDependencyTests-789385698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482" returned: 0 in 1.012s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e37a8f4a-84a3-4bdf-a27f-db1db7bd237a tempest-SnapshotDependencyTests-789385698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.7a6358cb-2919-4705-a4e8-4761383c15d5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:32 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.7a6358cb-2919-4705-a4e8-4761383c15d5 Jul 07 17:31:32 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:33 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:31:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Flow 'volume_create_manager' (c7c009f7-d39c-4980-bfd7-73ed84c31800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e13054-b38b-4056-950f-1a9cba5824d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e13054-b38b-4056-950f-1a9cba5824d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2113621471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3192418c-5530-4b16-ac83-be8fe92e233f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa07353508dd4b2f83e2ff37a3f4f92b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=02389c7b-b92b-44ac-8825-0e1f5ae0c1ba,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:33Z,use_quota=True,user_id='08518f6333ea42ff93d2b9b27c27b367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a0fc7b-8dda-438e-bf09-5c9defea5744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a0fc7b-8dda-438e-bf09-5c9defea5744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1317d9-3ead-4d94-9bc8-d3cf7bb02b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1317d9-3ead-4d94-9bc8-d3cf7bb02b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3192418c-5530-4b16-ac83-be8fe92e233f', 'volume_name': 'volume-3192418c-5530-4b16-ac83-be8fe92e233f', 'volume_size': 1, 'snapshot_id': '02389c7b-b92b-44ac-8825-0e1f5ae0c1ba'}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68bbb4d4-4535-4511-8d4b-c25301288518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68bbb4d4-4535-4511-8d4b-c25301288518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4ed98a-8a54-48d1-b577-3f8267788511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:33 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Volume 3192418c-5530-4b16-ac83-be8fe92e233f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3192418c-5530-4b16-ac83-be8fe92e233f', 'volume_size': 1, 'snapshot_id': '02389c7b-b92b-44ac-8825-0e1f5ae0c1ba'} Jul 07 17:31:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:33 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8b3ad82-f476-49a7-9cdb-9055a6647cb5 1073741824" returned: 0 in 1.214s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8b3ad82-f476-49a7-9cdb-9055a6647cb5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:33 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8b3ad82-f476-49a7-9cdb-9055a6647cb5 Jul 07 17:31:33 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:33 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Flow 'volume_create_manager' (f72af48f-1c6b-4980-a030-833a5227e168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0adf4698-4b1e-44a6-8dbf-a19adf80be0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:34 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e37a8f4a-84a3-4bdf-a27f-db1db7bd237a tempest-SnapshotDependencyTests-789385698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.7a6358cb-2919-4705-a4e8-4761383c15d5" returned: 0 in 1.232s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e37a8f4a-84a3-4bdf-a27f-db1db7bd237a tempest-SnapshotDependencyTests-789385698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.7a6358cb-2919-4705-a4e8-4761383c15d5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0adf4698-4b1e-44a6-8dbf-a19adf80be0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1459935205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=acff8dbc-b82c-4fc5-9aef-1f1a03edf5b4,host='devstack@QuobyteHD#QuobyteHD',id=fa7f2752-3a9a-43a2-83a4-9c16811de0d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bf690e56ad4cac825da95f67d485ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:34Z,use_quota=True,user_id='c66f97be2ff945cd87f6359c4986d156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39bc6039-0c0e-4e35-bcdc-1be24b599b11),volume_type_id=39bc6039-0c0e-4e35-bcdc-1be24b599b11)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:34 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.7a6358cb-2919-4705-a4e8-4761383c15d5 Jul 07 17:31:34 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426d4733-b811-4a1a-9d33-d8a5c2a3d138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426d4733-b811-4a1a-9d33-d8a5c2a3d138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095b490c-76ab-4c6e-a69a-0d3a1c954249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095b490c-76ab-4c6e-a69a-0d3a1c954249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa7f2752-3a9a-43a2-83a4-9c16811de0d9', 'volume_name': 'volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e97c669-cefd-49c1-b581-8f6e32d7b984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e97c669-cefd-49c1-b581-8f6e32d7b984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382f118c-ffe9-4ff4-80f1-d554ea0094fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:34 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Volume fa7f2752-3a9a-43a2-83a4-9c16811de0d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9', 'volume_size': 1} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:34 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8b3ad82-f476-49a7-9cdb-9055a6647cb5" returned: 0 in 0.968s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] <== create_volume: return (2255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.258s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.102s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Acquiring lock "cinder-quobyte-02389c7b-b92b-44ac-8825-0e1f5ae0c1ba-3192418c-5530-4b16-ac83-be8fe92e233f" by "_create_volume_from_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb1b60d-d878-4940-a40a-729def53d403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8b3ad82-f476-49a7-9cdb-9055a6647cb5', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3ffccc-bede-4e4f-9625-228f4bc1105e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Lock "cinder-quobyte-02389c7b-b92b-44ac-8825-0e1f5ae0c1ba-3192418c-5530-4b16-ac83-be8fe92e233f" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Creating volume 3192418c-5530-4b16-ac83-be8fe92e233f from snapshot 02389c7b-b92b-44ac-8825-0e1f5ae0c1ba {{(pid=87303) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Acquiring lock "cinder-quobyte-3192418c-5530-4b16-ac83-be8fe92e233f" by "_copy_volume_from_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:34 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Volume volume-e8b3ad82-f476-49a7-9cdb-9055a6647cb5 (e8b3ad82-f476-49a7-9cdb-9055a6647cb5): created successfully Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3ffccc-bede-4e4f-9625-228f4bc1105e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Flow 'volume_create_manager' (82daa1a8-0e38-4e02-8ce3-c9c737fe17ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Lock "cinder-quobyte-3192418c-5530-4b16-ac83-be8fe92e233f" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] snapshot: 02389c7b-b92b-44ac-8825-0e1f5ae0c1ba, volume: 3192418c-5530-4b16-ac83-be8fe92e233f, {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:31:34 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-9daf2dce-8cb0-4fbd-b952-d8956b326f07 tempest-VolumesTransfersV357Test-2093367640 None] Created volume successfully. Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76d5f9d-ae33-4208-b56a-18df87a0696f]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.02389c7b-b92b-44ac-8825-0e1f5ae0c1ba {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:34 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.02389c7b-b92b-44ac-8825-0e1f5ae0c1ba Jul 07 17:31:34 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:35 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e37a8f4a-84a3-4bdf-a27f-db1db7bd237a tempest-SnapshotDependencyTests-789385698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482.7a6358cb-2919-4705-a4e8-4761383c15d5" returned: 0 in 1.094s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e37a8f4a-84a3-4bdf-a27f-db1db7bd237a tempest-SnapshotDependencyTests-789385698 None] Lock "cinder-quobyte-7a6358cb-2919-4705-a4e8-4761383c15d5" released by "_delete_snapshot" :: held 4.435s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e37a8f4a-84a3-4bdf-a27f-db1db7bd237a tempest-SnapshotDependencyTests-789385698 None] Lock "cinder-quobyte-41043c6f-1330-4d24-9261-0f0a9a449482" released by "delete_snapshot" :: held 4.468s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:35 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-e37a8f4a-84a3-4bdf-a27f-db1db7bd237a tempest-SnapshotDependencyTests-789385698 None] Created reservations ['9ef492a1-c819-44aa-bbc5-81a60e4c85e9', '5e620920-2aa8-4249-b830-830c46103e32', '42308c41-a77e-4856-ab73-ee09d58a327f', '7ecd77ae-c283-4049-a7dc-437e8298339c'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:35 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-e37a8f4a-84a3-4bdf-a27f-db1db7bd237a tempest-SnapshotDependencyTests-789385698 None] Delete snapshot completed successfully. Jul 07 17:31:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e37a8f4a-84a3-4bdf-a27f-db1db7bd237a tempest-SnapshotDependencyTests-789385698 None] Lock "cinder-7a6358cb-2919-4705-a4e8-4761383c15d5-delete_snapshot" released by "delete_snapshot" :: held 4.702s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:35 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-9461751b-4c22-4dc8-96d7-a9de1632d73d tempest-VolumesTransfersV357Test-1547126484 None] Transfer volume completed successfully. Jul 07 17:31:35 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.02389c7b-b92b-44ac-8825-0e1f5ae0c1ba" returned: 0 in 1.082s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:35 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38e9342c-3870-4c66-bb34-7d85667ab9f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:31:35 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:31:35 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Creating direct copy from snapshot {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:31:35 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a72a2a-e493-4816-86d3-6da49019a5aa]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:35 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 Jul 07 17:31:35 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-37ded7de-4a8a-4274-92f1-37fa65d998d4 tempest-SnapshotDependencyTests-789385698 None] Acquiring lock "cinder-41043c6f-1330-4d24-9261-0f0a9a449482-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-37ded7de-4a8a-4274-92f1-37fa65d998d4 tempest-SnapshotDependencyTests-789385698 None] Lock "cinder-41043c6f-1330-4d24-9261-0f0a9a449482-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-37ded7de-4a8a-4274-92f1-37fa65d998d4 tempest-SnapshotDependencyTests-789385698 None] Acquiring lock "cinder-quobyte-41043c6f-1330-4d24-9261-0f0a9a449482" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-37ded7de-4a8a-4274-92f1-37fa65d998d4 tempest-SnapshotDependencyTests-789385698 None] Lock "cinder-quobyte-41043c6f-1330-4d24-9261-0f0a9a449482" acquired by "delete_volume" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:36 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e8263f-1d33-459d-84d1-140dc0709bf0]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-37ded7de-4a8a-4274-92f1-37fa65d998d4 tempest-SnapshotDependencyTests-789385698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:36 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482 Jul 07 17:31:36 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:36 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6" returned: 0 in 1.041s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:36 devstack cinder-volume[87303]: DEBUG cinder.utils [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Path /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3192418c-5530-4b16-ac83-be8fe92e233f not found in is_blk_device check {{(pid=87303) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:31:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3192418c-5530-4b16-ac83-be8fe92e233f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:36 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3192418c-5530-4b16-ac83-be8fe92e233f Jul 07 17:31:36 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4b77c825-79ce-43f4-8e5a-ddfed9aa44e3 tempest-VolumesTransfersV357Test-1312864129 None] Acquiring lock "cinder-e8b3ad82-f476-49a7-9cdb-9055a6647cb5-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4b77c825-79ce-43f4-8e5a-ddfed9aa44e3 tempest-VolumesTransfersV357Test-1312864129 None] Lock "cinder-e8b3ad82-f476-49a7-9cdb-9055a6647cb5-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:37 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4b77c825-79ce-43f4-8e5a-ddfed9aa44e3 tempest-VolumesTransfersV357Test-1312864129 None] Acquiring lock "cinder-quobyte-e8b3ad82-f476-49a7-9cdb-9055a6647cb5" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:37 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4b77c825-79ce-43f4-8e5a-ddfed9aa44e3 tempest-VolumesTransfersV357Test-1312864129 None] Lock "cinder-quobyte-e8b3ad82-f476-49a7-9cdb-9055a6647cb5" acquired by "delete_volume" :: waited 0.040s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:37 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dcda62-9e7c-4564-aff8-834602b85c58]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4b77c825-79ce-43f4-8e5a-ddfed9aa44e3 tempest-VolumesTransfersV357Test-1312864129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8b3ad82-f476-49a7-9cdb-9055a6647cb5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:37 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8b3ad82-f476-49a7-9cdb-9055a6647cb5 Jul 07 17:31:37 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:37 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-37ded7de-4a8a-4274-92f1-37fa65d998d4 tempest-SnapshotDependencyTests-789385698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482" returned: 0 in 1.254s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-37ded7de-4a8a-4274-92f1-37fa65d998d4 tempest-SnapshotDependencyTests-789385698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:37 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482 Jul 07 17:31:37 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:38 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4b77c825-79ce-43f4-8e5a-ddfed9aa44e3 tempest-VolumesTransfersV357Test-1312864129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8b3ad82-f476-49a7-9cdb-9055a6647cb5" returned: 0 in 1.559s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4b77c825-79ce-43f4-8e5a-ddfed9aa44e3 tempest-VolumesTransfersV357Test-1312864129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8b3ad82-f476-49a7-9cdb-9055a6647cb5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:38 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8b3ad82-f476-49a7-9cdb-9055a6647cb5 Jul 07 17:31:38 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:39 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-37ded7de-4a8a-4274-92f1-37fa65d998d4 tempest-SnapshotDependencyTests-789385698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-41043c6f-1330-4d24-9261-0f0a9a449482" returned: 0 in 1.565s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:39 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-37ded7de-4a8a-4274-92f1-37fa65d998d4 tempest-SnapshotDependencyTests-789385698 None] Lock "cinder-quobyte-41043c6f-1330-4d24-9261-0f0a9a449482" released by "delete_volume" :: held 2.967s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:39 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:UPDATE=85,cinder:SELECT=82,cinder:INSERT=20,cinder:DELETE=6 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:31:39 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-37ded7de-4a8a-4274-92f1-37fa65d998d4 tempest-SnapshotDependencyTests-789385698 None] Created reservations ['a6d4171c-fdb8-4fbc-a603-61eb37efe98d', '60975ff9-5f95-4e18-8495-41166bdfef69', '4bf344af-2713-4a49-a5a7-8f666576505b', 'eca98a45-a6df-4963-8932-079d5b87b504'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-37ded7de-4a8a-4274-92f1-37fa65d998d4 tempest-SnapshotDependencyTests-789385698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-37ded7de-4a8a-4274-92f1-37fa65d998d4 tempest-SnapshotDependencyTests-789385698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:39 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-37ded7de-4a8a-4274-92f1-37fa65d998d4 tempest-SnapshotDependencyTests-789385698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:39 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-37ded7de-4a8a-4274-92f1-37fa65d998d4 tempest-SnapshotDependencyTests-789385698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-37ded7de-4a8a-4274-92f1-37fa65d998d4 tempest-SnapshotDependencyTests-789385698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-37ded7de-4a8a-4274-92f1-37fa65d998d4 tempest-SnapshotDependencyTests-789385698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:39 devstack sudo[99981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:31:39 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:41 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4b77c825-79ce-43f4-8e5a-ddfed9aa44e3 tempest-VolumesTransfersV357Test-1312864129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8b3ad82-f476-49a7-9cdb-9055a6647cb5" returned: 0 in 2.297s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:41 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4b77c825-79ce-43f4-8e5a-ddfed9aa44e3 tempest-VolumesTransfersV357Test-1312864129 None] Lock "cinder-quobyte-e8b3ad82-f476-49a7-9cdb-9055a6647cb5" released by "delete_volume" :: held 3.997s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:41 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7b613e93-d9f9-412a-9681-dcd91f1b94dc tempest-SnapshotDependencyTests-789385698 None] Acquiring lock "cinder-8f890997-e1b1-48e6-84d8-fbdca3efb17f-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:41 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7b613e93-d9f9-412a-9681-dcd91f1b94dc tempest-SnapshotDependencyTests-789385698 None] Lock "cinder-8f890997-e1b1-48e6-84d8-fbdca3efb17f-delete_volume" acquired by "delete_volume" :: waited 0.125s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:41 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-4b77c825-79ce-43f4-8e5a-ddfed9aa44e3 tempest-VolumesTransfersV357Test-1312864129 None] Created reservations ['9cf1ca14-4e0b-40e5-a029-b9cd9331cddb', 'cc4d3bfa-8244-470e-ab71-294b962ea41e', '043d0597-b97e-4ea0-8aa0-31050089e214', '64b63a34-382d-4232-962b-cf05ed9c0c6f'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:41 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7b613e93-d9f9-412a-9681-dcd91f1b94dc tempest-SnapshotDependencyTests-789385698 None] Acquiring lock "cinder-quobyte-8f890997-e1b1-48e6-84d8-fbdca3efb17f" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:41 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7b613e93-d9f9-412a-9681-dcd91f1b94dc tempest-SnapshotDependencyTests-789385698 None] Lock "cinder-quobyte-8f890997-e1b1-48e6-84d8-fbdca3efb17f" acquired by "delete_volume" :: waited 0.064s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:41 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb524c35-78b3-4fd3-9984-a9e0f0b41a6a]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7b613e93-d9f9-412a-9681-dcd91f1b94dc tempest-SnapshotDependencyTests-789385698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f890997-e1b1-48e6-84d8-fbdca3efb17f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:41 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-37ded7de-4a8a-4274-92f1-37fa65d998d4 tempest-SnapshotDependencyTests-789385698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 2.163s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:41 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-37ded7de-4a8a-4274-92f1-37fa65d998d4 tempest-SnapshotDependencyTests-789385698 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:41 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f890997-e1b1-48e6-84d8-fbdca3efb17f Jul 07 17:31:41 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-37ded7de-4a8a-4274-92f1-37fa65d998d4 tempest-SnapshotDependencyTests-789385698 None] Deleted volume successfully. Jul 07 17:31:41 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4b77c825-79ce-43f4-8e5a-ddfed9aa44e3 tempest-VolumesTransfersV357Test-1312864129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4b77c825-79ce-43f4-8e5a-ddfed9aa44e3 tempest-VolumesTransfersV357Test-1312864129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4b77c825-79ce-43f4-8e5a-ddfed9aa44e3 tempest-VolumesTransfersV357Test-1312864129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4b77c825-79ce-43f4-8e5a-ddfed9aa44e3 tempest-VolumesTransfersV357Test-1312864129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4b77c825-79ce-43f4-8e5a-ddfed9aa44e3 tempest-VolumesTransfersV357Test-1312864129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4b77c825-79ce-43f4-8e5a-ddfed9aa44e3 tempest-VolumesTransfersV357Test-1312864129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:42 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-37ded7de-4a8a-4274-92f1-37fa65d998d4 tempest-SnapshotDependencyTests-789385698 None] Lock "cinder-41043c6f-1330-4d24-9261-0f0a9a449482-delete_volume" released by "delete_volume" :: held 6.002s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:42 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:31:42 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:43 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4b77c825-79ce-43f4-8e5a-ddfed9aa44e3 tempest-VolumesTransfersV357Test-1312864129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.587s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:43 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-4b77c825-79ce-43f4-8e5a-ddfed9aa44e3 tempest-VolumesTransfersV357Test-1312864129 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:43 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-4b77c825-79ce-43f4-8e5a-ddfed9aa44e3 tempest-VolumesTransfersV357Test-1312864129 None] Deleted volume successfully. Jul 07 17:31:43 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4b77c825-79ce-43f4-8e5a-ddfed9aa44e3 tempest-VolumesTransfersV357Test-1312864129 None] Lock "cinder-e8b3ad82-f476-49a7-9cdb-9055a6647cb5-delete_volume" released by "delete_volume" :: held 6.845s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:45 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:31:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Flow 'volume_create_manager' (8491f3dc-747a-4bde-bb5e-66d5547c3f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824b4df5-bfd6-4b18-a693-6800c86c9709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:45 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7b613e93-d9f9-412a-9681-dcd91f1b94dc tempest-SnapshotDependencyTests-789385698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f890997-e1b1-48e6-84d8-fbdca3efb17f" returned: 0 in 3.581s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7b613e93-d9f9-412a-9681-dcd91f1b94dc tempest-SnapshotDependencyTests-789385698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f890997-e1b1-48e6-84d8-fbdca3efb17f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824b4df5-bfd6-4b18-a693-6800c86c9709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-467014109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62555a64-4a53-4db9-bad3-a6dc85566995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0feb3770aa6444a1b7619d63149f7fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:45Z,use_quota=True,user_id='867c8d8eeef34618a59ea5801589d032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89760e59-3dfc-4e08-bf53-735e137995c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:45 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89760e59-3dfc-4e08-bf53-735e137995c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (595870eb-ff8b-4efc-a0e1-68a9df034f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (595870eb-ff8b-4efc-a0e1-68a9df034f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62555a64-4a53-4db9-bad3-a6dc85566995', 'volume_name': 'volume-62555a64-4a53-4db9-bad3-a6dc85566995', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:45 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f890997-e1b1-48e6-84d8-fbdca3efb17f Jul 07 17:31:45 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54adc55f-7f0e-455f-8c90-e8264d26d108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54adc55f-7f0e-455f-8c90-e8264d26d108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d24167b-c946-4296-9c3b-64790a5c30ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:45 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Volume 62555a64-4a53-4db9-bad3-a6dc85566995: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62555a64-4a53-4db9-bad3-a6dc85566995', 'volume_size': 1} Jul 07 17:31:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3192418c-5530-4b16-ac83-be8fe92e233f" returned: 0 in 8.650s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:45 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[62caaabf-0314-4ced-a4d0-8c2d14a1a6ed]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:45 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 Jul 07 17:31:45 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:46 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7b613e93-d9f9-412a-9681-dcd91f1b94dc tempest-SnapshotDependencyTests-789385698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f890997-e1b1-48e6-84d8-fbdca3efb17f" returned: 0 in 1.050s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:46 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7b613e93-d9f9-412a-9681-dcd91f1b94dc tempest-SnapshotDependencyTests-789385698 None] Lock "cinder-quobyte-8f890997-e1b1-48e6-84d8-fbdca3efb17f" released by "delete_volume" :: held 4.779s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:46 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-7b613e93-d9f9-412a-9681-dcd91f1b94dc tempest-SnapshotDependencyTests-789385698 None] Created reservations ['086dc588-dfaa-4a2a-b90a-b7d1112a9292', 'bc28620a-c4d9-48f1-9744-0b26e6419f9e', '993fa654-2fc9-479e-a45c-8bd879e3eaee', '36b341fe-23d5-4912-8407-2f7bcac7a621'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7b613e93-d9f9-412a-9681-dcd91f1b94dc tempest-SnapshotDependencyTests-789385698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7b613e93-d9f9-412a-9681-dcd91f1b94dc tempest-SnapshotDependencyTests-789385698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7b613e93-d9f9-412a-9681-dcd91f1b94dc tempest-SnapshotDependencyTests-789385698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7b613e93-d9f9-412a-9681-dcd91f1b94dc tempest-SnapshotDependencyTests-789385698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7b613e93-d9f9-412a-9681-dcd91f1b94dc tempest-SnapshotDependencyTests-789385698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7b613e93-d9f9-412a-9681-dcd91f1b94dc tempest-SnapshotDependencyTests-789385698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:46 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:31:46 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:47 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6" returned: 0 in 1.769s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:47 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Image conversion details: src /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6, size 1024.00 MB, duration 8.65 sec, destination /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3192418c-5530-4b16-ac83-be8fe92e233f {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:31:47 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Converted 1024.00 MB image at 118.36 MB/s Jul 07 17:31:47 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3192418c-5530-4b16-ac83-be8fe92e233f is being set with open permissions: ugo+rw Jul 07 17:31:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3192418c-5530-4b16-ac83-be8fe92e233f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:47 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3192418c-5530-4b16-ac83-be8fe92e233f Jul 07 17:31:47 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:48 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7b613e93-d9f9-412a-9681-dcd91f1b94dc tempest-SnapshotDependencyTests-789385698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.358s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:48 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-7b613e93-d9f9-412a-9681-dcd91f1b94dc tempest-SnapshotDependencyTests-789385698 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:48 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-7b613e93-d9f9-412a-9681-dcd91f1b94dc tempest-SnapshotDependencyTests-789385698 None] Deleted volume successfully. Jul 07 17:31:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7b613e93-d9f9-412a-9681-dcd91f1b94dc tempest-SnapshotDependencyTests-789385698 None] Lock "cinder-8f890997-e1b1-48e6-84d8-fbdca3efb17f-delete_volume" released by "delete_volume" :: held 6.829s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:48 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3192418c-5530-4b16-ac83-be8fe92e233f" returned: 0 in 1.000s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Lock "cinder-quobyte-3192418c-5530-4b16-ac83-be8fe92e233f" released by "_copy_volume_from_snapshot" :: held 13.741s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Lock "cinder-quobyte-02389c7b-b92b-44ac-8825-0e1f5ae0c1ba-3192418c-5530-4b16-ac83-be8fe92e233f" released by "_create_volume_from_snapshot" :: held 13.807s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.851s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.084s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=acff8dbc-b82c-4fc5-9aef-1f1a03edf5b4,created_at=2026-07-07T15:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1459935205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=acff8dbc-b82c-4fc5-9aef-1f1a03edf5b4,host='devstack@QuobyteHD#QuobyteHD',id=fa7f2752-3a9a-43a2-83a4-9c16811de0d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bf690e56ad4cac825da95f67d485ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:34Z,use_quota=True,user_id='c66f97be2ff945cd87f6359c4986d156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39bc6039-0c0e-4e35-bcdc-1be24b599b11),volume_type_id=39bc6039-0c0e-4e35-bcdc-1be24b599b11)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:31:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Creating volume fa7f2752-3a9a-43a2-83a4-9c16811de0d9 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:31:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:31:48 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:31:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:48 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9 1073741824 Jul 07 17:31:48 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4ed98a-8a54-48d1-b577-3f8267788511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3192418c-5530-4b16-ac83-be8fe92e233f', 'volume_size': 1, 'snapshot_id': '02389c7b-b92b-44ac-8825-0e1f5ae0c1ba'}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa5db39-34ad-48e6-a44a-ca1c84ba4550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:48 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Volume volume-3192418c-5530-4b16-ac83-be8fe92e233f (3192418c-5530-4b16-ac83-be8fe92e233f): created successfully Jul 07 17:31:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa5db39-34ad-48e6-a44a-ca1c84ba4550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Flow 'volume_create_manager' (c7c009f7-d39c-4980-bfd7-73ed84c31800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:48 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-d0c9668b-321d-4211-8a6e-b058d8aae776 tempest-TestStampPattern-407190565 None] Created volume successfully. Jul 07 17:31:49 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9 1073741824" returned: 0 in 1.115s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:49 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9 Jul 07 17:31:49 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:50 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9" returned: 0 in 0.857s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] <== create_volume: return (2028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:31:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.031s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.880s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-467014109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62555a64-4a53-4db9-bad3-a6dc85566995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0feb3770aa6444a1b7619d63149f7fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:31:45Z,use_quota=True,user_id='867c8d8eeef34618a59ea5801589d032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:31:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Creating volume 62555a64-4a53-4db9-bad3-a6dc85566995 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:31:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:31:50 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:31:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-62555a64-4a53-4db9-bad3-a6dc85566995 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:50 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-62555a64-4a53-4db9-bad3-a6dc85566995 1073741824 Jul 07 17:31:50 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382f118c-ffe9-4ff4-80f1-d554ea0094fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b6def0-79cd-4722-9f61-556f5cbf6a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:50 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Volume volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9 (fa7f2752-3a9a-43a2-83a4-9c16811de0d9): created successfully Jul 07 17:31:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b6def0-79cd-4722-9f61-556f5cbf6a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Flow 'volume_create_manager' (f72af48f-1c6b-4980-a030-833a5227e168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:50 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5b7d8fe3-ac80-41ab-afb8-3f4785526216 tempest-GroupSnapshotsTest-1684738746 None] Created volume successfully. Jul 07 17:31:51 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-c1413038-bb9b-4579-ab44-969babf61fb9 tempest-GroupSnapshotsTest-1684738746 None] Update group completed successfully. Jul 07 17:31:51 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-62555a64-4a53-4db9-bad3-a6dc85566995 1073741824" returned: 0 in 1.233s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-62555a64-4a53-4db9-bad3-a6dc85566995 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:51 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-62555a64-4a53-4db9-bad3-a6dc85566995 Jul 07 17:31:51 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:52 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-62555a64-4a53-4db9-bad3-a6dc85566995" returned: 0 in 0.858s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:52 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] <== create_volume: return (2140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:31:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.143s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d24167b-c946-4296-9c3b-64790a5c30ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62555a64-4a53-4db9-bad3-a6dc85566995', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06edf125-6019-4328-8334-7807cc2f4019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:31:52 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Volume volume-62555a64-4a53-4db9-bad3-a6dc85566995 (62555a64-4a53-4db9-bad3-a6dc85566995): created successfully Jul 07 17:31:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06edf125-6019-4328-8334-7807cc2f4019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:31:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Flow 'volume_create_manager' (8491f3dc-747a-4bde-bb5e-66d5547c3f2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:31:52 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-628e0b99-72d0-4ea8-a997-9c91722b9b87 tempest-VolumesTransfersV357Test-2093367640 None] Created volume successfully. Jul 07 17:31:52 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-ca0022f3-0260-45fc-9d39-3fd0d24a1538 tempest-GroupSnapshotsTest-1684738746 None] Update group completed successfully. Jul 07 17:31:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5750aef9-8801-4394-adb5-ea92aaeba102 tempest-VolumesTransfersV357Test-1312864129 None] Acquiring lock "cinder-62555a64-4a53-4db9-bad3-a6dc85566995-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5750aef9-8801-4394-adb5-ea92aaeba102 tempest-VolumesTransfersV357Test-1312864129 None] Lock "cinder-62555a64-4a53-4db9-bad3-a6dc85566995-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5750aef9-8801-4394-adb5-ea92aaeba102 tempest-VolumesTransfersV357Test-1312864129 None] Acquiring lock "cinder-quobyte-62555a64-4a53-4db9-bad3-a6dc85566995" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:31:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5750aef9-8801-4394-adb5-ea92aaeba102 tempest-VolumesTransfersV357Test-1312864129 None] Lock "cinder-quobyte-62555a64-4a53-4db9-bad3-a6dc85566995" acquired by "delete_volume" :: waited 0.033s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:31:53 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0aef934-2544-4564-8004-d0d2fd25d78b]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5750aef9-8801-4394-adb5-ea92aaeba102 tempest-VolumesTransfersV357Test-1312864129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-62555a64-4a53-4db9-bad3-a6dc85566995 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:54 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-19a0e507-da72-40f5-9cfc-45dd73e4727d tempest-GroupSnapshotsTest-1684738746 None] Update group completed successfully. Jul 07 17:31:54 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-62555a64-4a53-4db9-bad3-a6dc85566995 Jul 07 17:31:54 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:55 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5750aef9-8801-4394-adb5-ea92aaeba102 tempest-VolumesTransfersV357Test-1312864129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-62555a64-4a53-4db9-bad3-a6dc85566995" returned: 0 in 1.189s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5750aef9-8801-4394-adb5-ea92aaeba102 tempest-VolumesTransfersV357Test-1312864129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-62555a64-4a53-4db9-bad3-a6dc85566995 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:55 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-62555a64-4a53-4db9-bad3-a6dc85566995 Jul 07 17:31:55 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:55 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-89c141e9-f4e0-4ed0-bb1b-97b36a3b1953 tempest-GroupSnapshotsTest-1684738746 None] Update group completed successfully. Jul 07 17:31:56 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5750aef9-8801-4394-adb5-ea92aaeba102 tempest-VolumesTransfersV357Test-1312864129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-62555a64-4a53-4db9-bad3-a6dc85566995" returned: 0 in 1.173s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5750aef9-8801-4394-adb5-ea92aaeba102 tempest-VolumesTransfersV357Test-1312864129 None] Lock "cinder-quobyte-62555a64-4a53-4db9-bad3-a6dc85566995" released by "delete_volume" :: held 2.463s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:56 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-5750aef9-8801-4394-adb5-ea92aaeba102 tempest-VolumesTransfersV357Test-1312864129 None] Created reservations ['b7968df0-f035-4609-93e6-f18df4767341', '4ef2b61d-2409-4b24-99b4-5093aa632fe3', '958b362a-e049-44d9-ae49-9f85216913fa', '5c983f49-7e26-40ee-92f5-0647b9565c18'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:31:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5750aef9-8801-4394-adb5-ea92aaeba102 tempest-VolumesTransfersV357Test-1312864129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5750aef9-8801-4394-adb5-ea92aaeba102 tempest-VolumesTransfersV357Test-1312864129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5750aef9-8801-4394-adb5-ea92aaeba102 tempest-VolumesTransfersV357Test-1312864129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5750aef9-8801-4394-adb5-ea92aaeba102 tempest-VolumesTransfersV357Test-1312864129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5750aef9-8801-4394-adb5-ea92aaeba102 tempest-VolumesTransfersV357Test-1312864129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5750aef9-8801-4394-adb5-ea92aaeba102 tempest-VolumesTransfersV357Test-1312864129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:31:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:31:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:31:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:31:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:56 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:31:56 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:56 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:31:56 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:57 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] GroupSnapshot b5103062-d35d-42c5-8696-4197003a755d: creating. Jul 07 17:31:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] Group snapshot b5103062-d35d-42c5-8696-4197003a755d: creating. {{(pid=87303) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 17:31:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:31:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:31:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] Creating offline snapshot 01fe9899-a94e-4b94-a04e-b0f0faaea96b of volume 5b01230d-92cd-42b6-bcd4-440b1165d762 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:31:57 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbfd205-116b-4fa0-819f-9d4d844a9b09]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:31:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:58 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762 Jul 07 17:31:58 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:31:58 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5750aef9-8801-4394-adb5-ea92aaeba102 tempest-VolumesTransfersV357Test-1312864129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.517s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:58 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-5750aef9-8801-4394-adb5-ea92aaeba102 tempest-VolumesTransfersV357Test-1312864129 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:58 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5750aef9-8801-4394-adb5-ea92aaeba102 tempest-VolumesTransfersV357Test-1312864129 None] Deleted volume successfully. Jul 07 17:31:58 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5750aef9-8801-4394-adb5-ea92aaeba102 tempest-VolumesTransfersV357Test-1312864129 None] Lock "cinder-62555a64-4a53-4db9-bad3-a6dc85566995-delete_volume" released by "delete_volume" :: held 4.458s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:31:58 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 2.155s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:58 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:31:58 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:31:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:31:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:31:59 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Jul 07 17:31:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762" returned: 0 in 1.758s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:31:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.01fe9899-a94e-4b94-a04e-b0f0faaea96b 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:31:59 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.01fe9899-a94e-4b94-a04e-b0f0faaea96b 1G Jul 07 17:31:59 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:00 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.01fe9899-a94e-4b94-a04e-b0f0faaea96b 1G" returned: 0 in 1.293s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b01230d-92cd-42b6-bcd4-440b1165d762 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.01fe9899-a94e-4b94-a04e-b0f0faaea96b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:00 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b01230d-92cd-42b6-bcd4-440b1165d762 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.01fe9899-a94e-4b94-a04e-b0f0faaea96b Jul 07 17:32:00 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:01 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b01230d-92cd-42b6-bcd4-440b1165d762 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.01fe9899-a94e-4b94-a04e-b0f0faaea96b" returned: 0 in 1.085s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:01 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.01fe9899-a94e-4b94-a04e-b0f0faaea96b is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:32:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.01fe9899-a94e-4b94-a04e-b0f0faaea96b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:01 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.01fe9899-a94e-4b94-a04e-b0f0faaea96b Jul 07 17:32:01 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:03 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.01fe9899-a94e-4b94-a04e-b0f0faaea96b" returned: 0 in 1.441s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:03 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.info Jul 07 17:32:03 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:04 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.info" returned: 0 in 1.242s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:04 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:32:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:04 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.info Jul 07 17:32:04 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:05 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.info" returned: 0 in 1.082s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.113s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:05 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=89,cinder:UPDATE=103,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:32:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] Creating offline snapshot 056be7f1-e2f8-499b-9797-e9de04e6fad5 of volume fa7f2752-3a9a-43a2-83a4-9c16811de0d9 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:32:05 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91a9da0-3093-47f9-a174-04d116497674]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:06 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9 Jul 07 17:32:06 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:07 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9" returned: 0 in 1.379s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.056be7f1-e2f8-499b-9797-e9de04e6fad5 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:07 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.056be7f1-e2f8-499b-9797-e9de04e6fad5 1G Jul 07 17:32:07 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:08 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.056be7f1-e2f8-499b-9797-e9de04e6fad5 1G" returned: 0 in 1.119s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.056be7f1-e2f8-499b-9797-e9de04e6fad5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:08 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.056be7f1-e2f8-499b-9797-e9de04e6fad5 Jul 07 17:32:08 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:09 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.056be7f1-e2f8-499b-9797-e9de04e6fad5" returned: 0 in 0.816s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:09 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.056be7f1-e2f8-499b-9797-e9de04e6fad5 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:32:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.056be7f1-e2f8-499b-9797-e9de04e6fad5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:09 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.056be7f1-e2f8-499b-9797-e9de04e6fad5 Jul 07 17:32:09 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:09 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:32:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Flow 'volume_create_manager' (11f9f3e8-eae6-437a-8a1b-0f6ef03e4de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c401e590-4bec-4aa1-9188-1f5ac9206e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c401e590-4bec-4aa1-9188-1f5ac9206e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-610667762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7bece2-c702-4f96-8f6b-5c1658189d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb6469bf1c24878bc159ba860ed00be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:09Z,use_quota=True,user_id='c51d397bace74e7fbf497a9d7db1026e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea089281-bf60-4161-9766-c58647debea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea089281-bf60-4161-9766-c58647debea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (260c73ed-f942-4802-b621-ade2b2e9eeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (260c73ed-f942-4802-b621-ade2b2e9eeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b7bece2-c702-4f96-8f6b-5c1658189d69', 'volume_name': 'volume-4b7bece2-c702-4f96-8f6b-5c1658189d69', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b01a8fe-1b18-4ea6-b6e8-ff393e250326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b01a8fe-1b18-4ea6-b6e8-ff393e250326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d584a3fd-1ebe-4333-b655-e9d119159eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:09 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Volume 4b7bece2-c702-4f96-8f6b-5c1658189d69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b7bece2-c702-4f96-8f6b-5c1658189d69', 'volume_size': 1} Jul 07 17:32:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:09 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.056be7f1-e2f8-499b-9797-e9de04e6fad5" returned: 0 in 0.685s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:09 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.info Jul 07 17:32:09 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:10 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.info" returned: 0 in 0.721s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:10 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:32:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:10 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.info Jul 07 17:32:10 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:11 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.info" returned: 0 in 0.709s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.589s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.836s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-610667762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7bece2-c702-4f96-8f6b-5c1658189d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb6469bf1c24878bc159ba860ed00be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:09Z,use_quota=True,user_id='c51d397bace74e7fbf497a9d7db1026e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:32:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Creating volume 4b7bece2-c702-4f96-8f6b-5c1658189d69 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:32:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:32:11 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:32:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:11 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 1073741824 Jul 07 17:32:11 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:11 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-33738161-ab8f-443e-9d6b-41af5ae6f739 tempest-GroupSnapshotsTest-1684738746 None] group_snapshot b5103062-d35d-42c5-8696-4197003a755d: created successfully Jul 07 17:32:11 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] group_snapshot b5103062-d35d-42c5-8696-4197003a755d: deleting Jul 07 17:32:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] group_snapshot b5103062-d35d-42c5-8696-4197003a755d: deleting {{(pid=87303) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 17:32:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "cinder-quobyte-5b01230d-92cd-42b6-bcd4-440b1165d762" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-5b01230d-92cd-42b6-bcd4-440b1165d762" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "cinder-quobyte-01fe9899-a94e-4b94-a04e-b0f0faaea96b" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-01fe9899-a94e-4b94-a04e-b0f0faaea96b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Deleting offline snapshot 01fe9899-a94e-4b94-a04e-b0f0faaea96b of volume 5b01230d-92cd-42b6-bcd4-440b1165d762 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:32:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] snapshot_file for this snap is: volume-5b01230d-92cd-42b6-bcd4-440b1165d762.01fe9899-a94e-4b94-a04e-b0f0faaea96b {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:32:11 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[089f3694-a641-4bf8-828f-2d3202d532bf]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.01fe9899-a94e-4b94-a04e-b0f0faaea96b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:12 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.01fe9899-a94e-4b94-a04e-b0f0faaea96b Jul 07 17:32:12 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:12 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 1073741824" returned: 0 in 1.055s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:12 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 Jul 07 17:32:12 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:12 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.01fe9899-a94e-4b94-a04e-b0f0faaea96b" returned: 0 in 1.019s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b01230d-92cd-42b6-bcd4-440b1165d762(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:32:13 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[378f5b02-a42f-47c0-ae15-2590c142aeb9]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:13 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762 Jul 07 17:32:13 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:13 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69" returned: 0 in 0.759s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:32:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d584a3fd-1ebe-4333-b655-e9d119159eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b7bece2-c702-4f96-8f6b-5c1658189d69', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310338fa-76bd-4e22-83d3-6bdf57c5ba9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:13 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Volume volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 (4b7bece2-c702-4f96-8f6b-5c1658189d69): created successfully Jul 07 17:32:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310338fa-76bd-4e22-83d3-6bdf57c5ba9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Flow 'volume_create_manager' (11f9f3e8-eae6-437a-8a1b-0f6ef03e4de7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:13 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b2aa601e-ef93-43ff-8c5e-bd3f3b413089 tempest-VolumesCloneTest-1996112077 None] Created volume successfully. Jul 07 17:32:13 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762" returned: 0 in 0.948s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.01fe9899-a94e-4b94-a04e-b0f0faaea96b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:13 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.01fe9899-a94e-4b94-a04e-b0f0faaea96b Jul 07 17:32:13 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:14 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:32:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Flow 'volume_create_manager' (8e6fd144-9b3e-45d0-a943-3004a35ab6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9e0d532-fab5-4fdd-b3f7-b5565baf4847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9e0d532-fab5-4fdd-b3f7-b5565baf4847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-374498384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97780005-2fbb-4548-94ba-6cfb61d80553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb6469bf1c24878bc159ba860ed00be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4b7bece2-c702-4f96-8f6b-5c1658189d69,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:14Z,use_quota=True,user_id='c51d397bace74e7fbf497a9d7db1026e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8eaee4a-735a-44e0-aed3-bbb99f628825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8eaee4a-735a-44e0-aed3-bbb99f628825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5312b5f8-a198-4aa2-8bf9-cf2563f02b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5312b5f8-a198-4aa2-8bf9-cf2563f02b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '97780005-2fbb-4548-94ba-6cfb61d80553', 'volume_name': 'volume-97780005-2fbb-4548-94ba-6cfb61d80553', 'volume_size': 2, 'source_volid': '4b7bece2-c702-4f96-8f6b-5c1658189d69', 'source_volstatus': 'available'}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5237acd3-cdd8-4c6e-9c36-04d989aa9352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5237acd3-cdd8-4c6e-9c36-04d989aa9352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2873e9-ceee-43e5-a7bb-3caf6c590e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:14 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Volume 97780005-2fbb-4548-94ba-6cfb61d80553: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-97780005-2fbb-4548-94ba-6cfb61d80553', 'volume_size': 2, 'source_volid': '4b7bece2-c702-4f96-8f6b-5c1658189d69', 'source_volstatus': 'available'} Jul 07 17:32:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:14 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Cloning volume 4b7bece2-c702-4f96-8f6b-5c1658189d69 to volume 97780005-2fbb-4548-94ba-6cfb61d80553 Jul 07 17:32:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Creating offline snapshot d5b50735-acd8-42da-8ceb-ccbfa4c9ee04 of volume 4b7bece2-c702-4f96-8f6b-5c1658189d69 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:32:14 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c25b00-77b7-4d51-8243-0d91726112f6]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:14 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 Jul 07 17:32:14 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:14 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.01fe9899-a94e-4b94-a04e-b0f0faaea96b" returned: 0 in 0.963s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.01fe9899-a94e-4b94-a04e-b0f0faaea96b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:14 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.01fe9899-a94e-4b94-a04e-b0f0faaea96b Jul 07 17:32:14 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:15 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69" returned: 0 in 0.899s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.d5b50735-acd8-42da-8ceb-ccbfa4c9ee04 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:15 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.d5b50735-acd8-42da-8ceb-ccbfa4c9ee04 1G Jul 07 17:32:15 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:15 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762.01fe9899-a94e-4b94-a04e-b0f0faaea96b" returned: 0 in 0.822s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-01fe9899-a94e-4b94-a04e-b0f0faaea96b" released by "_delete_snapshot" :: held 3.924s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-5b01230d-92cd-42b6-bcd4-440b1165d762" released by "delete_snapshot" :: held 3.952s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "cinder-quobyte-fa7f2752-3a9a-43a2-83a4-9c16811de0d9" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-fa7f2752-3a9a-43a2-83a4-9c16811de0d9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "cinder-quobyte-056be7f1-e2f8-499b-9797-e9de04e6fad5" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-056be7f1-e2f8-499b-9797-e9de04e6fad5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Deleting offline snapshot 056be7f1-e2f8-499b-9797-e9de04e6fad5 of volume fa7f2752-3a9a-43a2-83a4-9c16811de0d9 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:32:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] snapshot_file for this snap is: volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.056be7f1-e2f8-499b-9797-e9de04e6fad5 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:32:15 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa5b3e5-aed6-4c08-b391-d7790907b08a]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.056be7f1-e2f8-499b-9797-e9de04e6fad5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:16 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.056be7f1-e2f8-499b-9797-e9de04e6fad5 Jul 07 17:32:16 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:16 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.d5b50735-acd8-42da-8ceb-ccbfa4c9ee04 1G" returned: 0 in 1.055s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.d5b50735-acd8-42da-8ceb-ccbfa4c9ee04 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:16 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.d5b50735-acd8-42da-8ceb-ccbfa4c9ee04 Jul 07 17:32:16 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:16 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.056be7f1-e2f8-499b-9797-e9de04e6fad5" returned: 0 in 0.907s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:16 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:32:16 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe04832-96ee-4342-938f-2a67766d902e]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:16 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9 Jul 07 17:32:16 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:17 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.d5b50735-acd8-42da-8ceb-ccbfa4c9ee04" returned: 0 in 0.940s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:17 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.d5b50735-acd8-42da-8ceb-ccbfa4c9ee04 is being set with open permissions: ugo+rw Jul 07 17:32:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.d5b50735-acd8-42da-8ceb-ccbfa4c9ee04 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:17 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.d5b50735-acd8-42da-8ceb-ccbfa4c9ee04 Jul 07 17:32:17 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:17 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9" returned: 0 in 0.961s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.056be7f1-e2f8-499b-9797-e9de04e6fad5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:17 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.056be7f1-e2f8-499b-9797-e9de04e6fad5 Jul 07 17:32:17 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:18 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.d5b50735-acd8-42da-8ceb-ccbfa4c9ee04" returned: 0 in 0.830s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:18 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.info Jul 07 17:32:18 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:18 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.056be7f1-e2f8-499b-9797-e9de04e6fad5" returned: 0 in 0.936s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.056be7f1-e2f8-499b-9797-e9de04e6fad5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:18 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.056be7f1-e2f8-499b-9797-e9de04e6fad5 Jul 07 17:32:18 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:19 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.info" returned: 0 in 0.900s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:19 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.info is being set with open permissions: ugo+rw Jul 07 17:32:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:19 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.info Jul 07 17:32:19 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:19 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9.056be7f1-e2f8-499b-9797-e9de04e6fad5" returned: 0 in 0.827s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-056be7f1-e2f8-499b-9797-e9de04e6fad5" released by "_delete_snapshot" :: held 3.771s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-fa7f2752-3a9a-43a2-83a4-9c16811de0d9" released by "delete_snapshot" :: held 3.797s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:19 devstack cinder-volume[87303]: WARNING cinder.quota [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1812003001 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1812003001, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:32:19 devstack cinder-volume[87303]: WARNING cinder.quota [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1812003001 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1812003001, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:32:19 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Created reservations ['003bcbf9-1377-4f85-bd8f-d4fa6b947429', '34e8c3a1-7e3e-4fd0-9a71-635b76f04228', '56348469-55be-4cae-a33d-b0299f0b6b01', 'd5c7a2a4-c49e-4e77-9df8-2ffff59e182f'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:19 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] Created reservations ['f52fe9f1-c4e2-41c6-bd90-6c0935321f8e', 'b47f3690-b9f7-4b39-9304-4ef49e7e1f4a', 'a6971a29-fe87-4aaf-9488-d668dae019e5', '3b7cae94-cd63-4366-8e5c-4b993418ba99'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:20 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-e8da3e37-a9a9-4370-b598-3a0a8617d8a4 tempest-GroupSnapshotsTest-1684738746 None] group_snapshot b5103062-d35d-42c5-8696-4197003a755d: deleted successfully Jul 07 17:32:20 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.info" returned: 0 in 0.857s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Acquiring lock "cinder-quobyte-97780005-2fbb-4548-94ba-6cfb61d80553" by "_copy_volume_from_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Lock "cinder-quobyte-97780005-2fbb-4548-94ba-6cfb61d80553" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] snapshot: d5b50735-acd8-42da-8ceb-ccbfa4c9ee04, volume: 97780005-2fbb-4548-94ba-6cfb61d80553, {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:32:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:20 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[195e55b9-b3f4-47b3-b635-777d0868429b]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.d5b50735-acd8-42da-8ceb-ccbfa4c9ee04 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:20 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.d5b50735-acd8-42da-8ceb-ccbfa4c9ee04 Jul 07 17:32:20 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:21 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.d5b50735-acd8-42da-8ceb-ccbfa4c9ee04" returned: 0 in 0.927s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b7bece2-c702-4f96-8f6b-5c1658189d69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:32:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:32:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Creating direct copy from snapshot {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:32:21 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafdc8d4-ee80-4fbb-940f-d94cb8fc895c]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "cinder-quobyte-5b01230d-92cd-42b6-bcd4-440b1165d762" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-5b01230d-92cd-42b6-bcd4-440b1165d762" acquired by "delete_volume" :: waited 0.027s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:21 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d489a8-ed39-480a-865a-e93844a7e62e]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:21 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 Jul 07 17:32:21 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:21 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762 Jul 07 17:32:21 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:22 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69" returned: 0 in 0.907s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:22 devstack cinder-volume[87303]: DEBUG cinder.utils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Path /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97780005-2fbb-4548-94ba-6cfb61d80553 not found in is_blk_device check {{(pid=87303) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:32:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97780005-2fbb-4548-94ba-6cfb61d80553 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:22 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97780005-2fbb-4548-94ba-6cfb61d80553 Jul 07 17:32:22 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:22 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762" returned: 0 in 0.894s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:22 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762 Jul 07 17:32:22 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:23 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5b01230d-92cd-42b6-bcd4-440b1165d762" returned: 0 in 0.909s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:23 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-5b01230d-92cd-42b6-bcd4-440b1165d762" released by "delete_volume" :: held 1.901s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:23 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "cinder-quobyte-fa7f2752-3a9a-43a2-83a4-9c16811de0d9" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:23 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-fa7f2752-3a9a-43a2-83a4-9c16811de0d9" acquired by "delete_volume" :: waited 0.038s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:23 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d9881e-a611-496e-8964-18f6bd415b22]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:23 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9 Jul 07 17:32:23 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:24 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9" returned: 0 in 1.706s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:25 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9 Jul 07 17:32:25 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:27 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fa7f2752-3a9a-43a2-83a4-9c16811de0d9" returned: 0 in 2.334s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-fa7f2752-3a9a-43a2-83a4-9c16811de0d9" released by "delete_volume" :: held 4.173s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:27 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] Created reservations ['b558b6a0-1adc-446e-9792-2dc68f919e44'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:27 devstack cinder-volume[87303]: WARNING cinder.quota [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1812003001 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1812003001, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:32:27 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] Created reservations ['716c7712-981b-46ea-bb06-9c324b3e9811', '78ff9d50-148d-4876-9aa7-06dcbb064f1f', '8899620e-3a7b-4e49-9cf4-5695f0b2168a', 'dffd5f79-0c1c-40d9-87c2-576d3b8243f3'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:27 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97780005-2fbb-4548-94ba-6cfb61d80553" returned: 0 in 5.841s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:27 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe8e358-269e-4c24-85b6-00e546e0ff77]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:27 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] Created reservations ['e554191f-dc22-42ff-9a92-466d6fe5f015', '581db084-4ae9-41b5-91dd-bebd4895e4b2', '0fa09fee-2eda-473f-9f14-87d58c71737d', '7fce17fd-9727-4214-b2dd-8e7656c402d0'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-03bda757-d887-4882-afd2-bd4bd365287f req-39f83ce1-f09c-4e30-a1f6-1d48d425d525 tempest-TestStampPattern-407190565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:28 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 Jul 07 17:32:28 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:28 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:32:28 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:28 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.682s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:28 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:32:28 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-c39c7a52-c653-40c0-9226-cdb4aee87068 tempest-GroupSnapshotsTest-1684738746 None] Delete group completed successfully. Jul 07 17:32:28 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69" returned: 0 in 1.044s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:29 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Image conversion details: src /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97780005-2fbb-4548-94ba-6cfb61d80553 {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:32:29 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Converted 1024.00 MB image at 175.29 MB/s Jul 07 17:32:29 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97780005-2fbb-4548-94ba-6cfb61d80553 is being set with open permissions: ugo+rw Jul 07 17:32:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97780005-2fbb-4548-94ba-6cfb61d80553 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:29 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97780005-2fbb-4548-94ba-6cfb61d80553 Jul 07 17:32:29 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:29 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-6cc477f7-3287-44c7-bba2-69c0065842cd tempest-GroupSnapshotsTest-1684738746 None] Group tempest-GroupSnapshotsTest-Group-17330797: creating Jul 07 17:32:29 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-6cc477f7-3287-44c7-bba2-69c0065842cd tempest-GroupSnapshotsTest-1684738746 None] Group tempest-GroupSnapshotsTest-Group-17330797: created successfully Jul 07 17:32:29 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-6cc477f7-3287-44c7-bba2-69c0065842cd tempest-GroupSnapshotsTest-1684738746 None] Create group completed successfully. Jul 07 17:32:29 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97780005-2fbb-4548-94ba-6cfb61d80553" returned: 0 in 0.775s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Lock "cinder-quobyte-97780005-2fbb-4548-94ba-6cfb61d80553" released by "_copy_volume_from_snapshot" :: held 9.590s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Acquiring lock "cinder-quobyte-d5b50735-acd8-42da-8ceb-ccbfa4c9ee04" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Lock "cinder-quobyte-d5b50735-acd8-42da-8ceb-ccbfa4c9ee04" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Deleting offline snapshot d5b50735-acd8-42da-8ceb-ccbfa4c9ee04 of volume 4b7bece2-c702-4f96-8f6b-5c1658189d69 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:32:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] snapshot_file for this snap is: volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.d5b50735-acd8-42da-8ceb-ccbfa4c9ee04 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:32:29 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe19290c-ad45-4aae-99e7-fb03c598fa1e]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.d5b50735-acd8-42da-8ceb-ccbfa4c9ee04 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:29 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.d5b50735-acd8-42da-8ceb-ccbfa4c9ee04 Jul 07 17:32:29 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:30 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.d5b50735-acd8-42da-8ceb-ccbfa4c9ee04" returned: 0 in 0.877s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b7bece2-c702-4f96-8f6b-5c1658189d69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:32:30 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[c526d1b1-c87a-4d79-9605-3985ad9a8d1c]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:30 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 Jul 07 17:32:30 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:31 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:32:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Flow 'volume_create_manager' (6af996a7-3d69-4c1b-9a2c-7f0e09c0f013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da3b9f8-be1f-4b9d-ac7e-bd9132d6019f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da3b9f8-be1f-4b9d-ac7e-bd9132d6019f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1566177761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b50d737f-477e-4973-9f30-f9bbc254503a,host='devstack@QuobyteHD#QuobyteHD',id=9454f5b4-fec4-4fe9-9a99-8f8b75b5f588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bf690e56ad4cac825da95f67d485ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:31Z,use_quota=True,user_id='c66f97be2ff945cd87f6359c4986d156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c5efbd5-1a58-430b-987a-b2f6a1647b7f),volume_type_id=6c5efbd5-1a58-430b-987a-b2f6a1647b7f)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd836e9-450b-4d30-bf54-ce156d20ae14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd836e9-450b-4d30-bf54-ce156d20ae14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d77751-4dbb-4c84-b9db-c102bdfe1c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d77751-4dbb-4c84-b9db-c102bdfe1c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9454f5b4-fec4-4fe9-9a99-8f8b75b5f588', 'volume_name': 'volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd58a59-d172-44b8-bfc8-9980f860bb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd58a59-d172-44b8-bfc8-9980f860bb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e379cd15-9a09-4ab7-ba83-5e3744efb9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:31 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Volume 9454f5b4-fec4-4fe9-9a99-8f8b75b5f588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588', 'volume_size': 1} Jul 07 17:32:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:31 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69" returned: 0 in 0.854s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.d5b50735-acd8-42da-8ceb-ccbfa4c9ee04 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:31 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.d5b50735-acd8-42da-8ceb-ccbfa4c9ee04 Jul 07 17:32:31 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:32 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.d5b50735-acd8-42da-8ceb-ccbfa4c9ee04" returned: 0 in 0.790s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.d5b50735-acd8-42da-8ceb-ccbfa4c9ee04 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:32 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.d5b50735-acd8-42da-8ceb-ccbfa4c9ee04 Jul 07 17:32:32 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:33 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69.d5b50735-acd8-42da-8ceb-ccbfa4c9ee04" returned: 0 in 0.679s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Lock "cinder-quobyte-d5b50735-acd8-42da-8ceb-ccbfa4c9ee04" released by "_delete_snapshot" :: held 3.326s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.632s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-03bda757-d887-4882-afd2-bd4bd365287f req-39f83ce1-f09c-4e30-a1f6-1d48d425d525 tempest-TestStampPattern-407190565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.119s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:33 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[686af0e0-2b14-4087-ac16-69d5797b93bb]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-03bda757-d887-4882-afd2-bd4bd365287f req-39f83ce1-f09c-4e30-a1f6-1d48d425d525 tempest-TestStampPattern-407190565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3192418c-5530-4b16-ac83-be8fe92e233f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2873e9-ceee-43e5-a7bb-3caf6c590e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97780005-2fbb-4548-94ba-6cfb61d80553', 'volume_size': 2, 'source_volid': '4b7bece2-c702-4f96-8f6b-5c1658189d69', 'source_volstatus': 'available'}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3425bd58-0243-4980-a5f6-a12381cc8e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:33 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Volume volume-97780005-2fbb-4548-94ba-6cfb61d80553 (97780005-2fbb-4548-94ba-6cfb61d80553): created successfully Jul 07 17:32:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3425bd58-0243-4980-a5f6-a12381cc8e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Flow 'volume_create_manager' (8e6fd144-9b3e-45d0-a943-3004a35ab6a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:33 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-147e2143-51be-4aab-ad8d-3b6b271c2689 tempest-VolumesCloneTest-1996112077 None] Created volume successfully. Jul 07 17:32:33 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3192418c-5530-4b16-ac83-be8fe92e233f Jul 07 17:32:33 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c30f5745-8f1d-4351-a3f5-535e57aac069 tempest-VolumesCloneTest-1996112077 None] Acquiring lock "cinder-97780005-2fbb-4548-94ba-6cfb61d80553-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c30f5745-8f1d-4351-a3f5-535e57aac069 tempest-VolumesCloneTest-1996112077 None] Lock "cinder-97780005-2fbb-4548-94ba-6cfb61d80553-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c30f5745-8f1d-4351-a3f5-535e57aac069 tempest-VolumesCloneTest-1996112077 None] Acquiring lock "cinder-quobyte-97780005-2fbb-4548-94ba-6cfb61d80553" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c30f5745-8f1d-4351-a3f5-535e57aac069 tempest-VolumesCloneTest-1996112077 None] Lock "cinder-quobyte-97780005-2fbb-4548-94ba-6cfb61d80553" acquired by "delete_volume" :: waited 0.023s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:33 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25a683b-8538-4b72-ab29-ca812fdde75d]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c30f5745-8f1d-4351-a3f5-535e57aac069 tempest-VolumesCloneTest-1996112077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97780005-2fbb-4548-94ba-6cfb61d80553 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:33 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97780005-2fbb-4548-94ba-6cfb61d80553 Jul 07 17:32:33 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:34 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-03bda757-d887-4882-afd2-bd4bd365287f req-39f83ce1-f09c-4e30-a1f6-1d48d425d525 tempest-TestStampPattern-407190565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3192418c-5530-4b16-ac83-be8fe92e233f" returned: 0 in 0.867s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-03bda757-d887-4882-afd2-bd4bd365287f req-39f83ce1-f09c-4e30-a1f6-1d48d425d525 tempest-TestStampPattern-407190565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.888s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.608s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b50d737f-477e-4973-9f30-f9bbc254503a,created_at=2026-07-07T15:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1566177761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b50d737f-477e-4973-9f30-f9bbc254503a,host='devstack@QuobyteHD#QuobyteHD',id=9454f5b4-fec4-4fe9-9a99-8f8b75b5f588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bf690e56ad4cac825da95f67d485ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:31Z,use_quota=True,user_id='c66f97be2ff945cd87f6359c4986d156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c5efbd5-1a58-430b-987a-b2f6a1647b7f),volume_type_id=6c5efbd5-1a58-430b-987a-b2f6a1647b7f)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:32:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Creating volume 9454f5b4-fec4-4fe9-9a99-8f8b75b5f588 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:32:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:32:34 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:32:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:34 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588 1073741824 Jul 07 17:32:34 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-03bda757-d887-4882-afd2-bd4bd365287f req-39f83ce1-f09c-4e30-a1f6-1d48d425d525 tempest-TestStampPattern-407190565 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2', 'name': 'volume-3192418c-5530-4b16-ac83-be8fe92e233f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b8ba4f2-ea7e-4887-ad1d-1757efeb1d96', 'enforce_multipath': True} {{(pid=87303) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:32:34 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-03bda757-d887-4882-afd2-bd4bd365287f req-39f83ce1-f09c-4e30-a1f6-1d48d425d525 tempest-TestStampPattern-407190565 None] attachment_update completed successfully. Jul 07 17:32:34 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c30f5745-8f1d-4351-a3f5-535e57aac069 tempest-VolumesCloneTest-1996112077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97780005-2fbb-4548-94ba-6cfb61d80553" returned: 0 in 0.930s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c30f5745-8f1d-4351-a3f5-535e57aac069 tempest-VolumesCloneTest-1996112077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97780005-2fbb-4548-94ba-6cfb61d80553 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:34 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97780005-2fbb-4548-94ba-6cfb61d80553 Jul 07 17:32:34 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:35 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588 1073741824" returned: 0 in 1.016s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:35 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588 Jul 07 17:32:35 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:35 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c30f5745-8f1d-4351-a3f5-535e57aac069 tempest-VolumesCloneTest-1996112077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-97780005-2fbb-4548-94ba-6cfb61d80553" returned: 0 in 0.858s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c30f5745-8f1d-4351-a3f5-535e57aac069 tempest-VolumesCloneTest-1996112077 None] Lock "cinder-quobyte-97780005-2fbb-4548-94ba-6cfb61d80553" released by "delete_volume" :: held 1.861s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:35 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-c30f5745-8f1d-4351-a3f5-535e57aac069 tempest-VolumesCloneTest-1996112077 None] Created reservations ['19dad4c5-82bb-4764-8bf3-f37a39e7262d', '37136af2-5ea1-40a1-82cc-2529b635502a', 'aca24141-2505-49b3-baf7-243cdcb7887e', 'e779ac20-efa4-432a-9587-aeedbcae3ea2'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c30f5745-8f1d-4351-a3f5-535e57aac069 tempest-VolumesCloneTest-1996112077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c30f5745-8f1d-4351-a3f5-535e57aac069 tempest-VolumesCloneTest-1996112077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:35 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c30f5745-8f1d-4351-a3f5-535e57aac069 tempest-VolumesCloneTest-1996112077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:35 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c30f5745-8f1d-4351-a3f5-535e57aac069 tempest-VolumesCloneTest-1996112077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c30f5745-8f1d-4351-a3f5-535e57aac069 tempest-VolumesCloneTest-1996112077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c30f5745-8f1d-4351-a3f5-535e57aac069 tempest-VolumesCloneTest-1996112077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:35 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:32:35 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:35 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588" returned: 0 in 0.738s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:35 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:32:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:35 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e379cd15-9a09-4ab7-ba83-5e3744efb9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712c9d40-50f7-4e7b-9492-050f6a17a5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:36 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Volume volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588 (9454f5b4-fec4-4fe9-9a99-8f8b75b5f588): created successfully Jul 07 17:32:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712c9d40-50f7-4e7b-9492-050f6a17a5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Flow 'volume_create_manager' (6af996a7-3d69-4c1b-9a2c-7f0e09c0f013) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:36 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-13583352-27c1-4e30-82aa-44fc20b056db tempest-GroupSnapshotsTest-1684738746 None] Created volume successfully. Jul 07 17:32:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5aa18727-3a0e-4fd5-abf8-ea5530f1fb3f tempest-VolumesCloneTest-1996112077 None] Acquiring lock "cinder-4b7bece2-c702-4f96-8f6b-5c1658189d69-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5aa18727-3a0e-4fd5-abf8-ea5530f1fb3f tempest-VolumesCloneTest-1996112077 None] Lock "cinder-4b7bece2-c702-4f96-8f6b-5c1658189d69-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5aa18727-3a0e-4fd5-abf8-ea5530f1fb3f tempest-VolumesCloneTest-1996112077 None] Acquiring lock "cinder-quobyte-4b7bece2-c702-4f96-8f6b-5c1658189d69" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5aa18727-3a0e-4fd5-abf8-ea5530f1fb3f tempest-VolumesCloneTest-1996112077 None] Lock "cinder-quobyte-4b7bece2-c702-4f96-8f6b-5c1658189d69" acquired by "delete_volume" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:36 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c15be1-19b3-413d-898a-697737372b9a]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5aa18727-3a0e-4fd5-abf8-ea5530f1fb3f tempest-VolumesCloneTest-1996112077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:36 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c30f5745-8f1d-4351-a3f5-535e57aac069 tempest-VolumesCloneTest-1996112077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.794s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:36 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-c30f5745-8f1d-4351-a3f5-535e57aac069 tempest-VolumesCloneTest-1996112077 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:32:36 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-c30f5745-8f1d-4351-a3f5-535e57aac069 tempest-VolumesCloneTest-1996112077 None] Deleted volume successfully. Jul 07 17:32:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c30f5745-8f1d-4351-a3f5-535e57aac069 tempest-VolumesCloneTest-1996112077 None] Lock "cinder-97780005-2fbb-4548-94ba-6cfb61d80553-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:36 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 Jul 07 17:32:36 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:37 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5aa18727-3a0e-4fd5-abf8-ea5530f1fb3f tempest-VolumesCloneTest-1996112077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69" returned: 0 in 0.914s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5aa18727-3a0e-4fd5-abf8-ea5530f1fb3f tempest-VolumesCloneTest-1996112077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:37 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69 Jul 07 17:32:37 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:37 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-cfc9907f-1357-4cd5-90a3-884fc27fe44e tempest-GroupSnapshotsTest-1684738746 None] GroupSnapshot b70557ba-c66e-438c-a74f-975da8931770: creating. Jul 07 17:32:37 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cfc9907f-1357-4cd5-90a3-884fc27fe44e tempest-GroupSnapshotsTest-1684738746 None] Group snapshot b70557ba-c66e-438c-a74f-975da8931770: creating. {{(pid=87303) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 17:32:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-cfc9907f-1357-4cd5-90a3-884fc27fe44e tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-cfc9907f-1357-4cd5-90a3-884fc27fe44e tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-cfc9907f-1357-4cd5-90a3-884fc27fe44e tempest-GroupSnapshotsTest-1684738746 None] Creating offline snapshot c891f3cb-bcb8-4976-8d53-6980f69cc10c of volume 9454f5b4-fec4-4fe9-9a99-8f8b75b5f588 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:32:37 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fcf3cf-e8a4-47e0-a60c-eee617c9977f]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cfc9907f-1357-4cd5-90a3-884fc27fe44e tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:37 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588 Jul 07 17:32:37 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:38 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5aa18727-3a0e-4fd5-abf8-ea5530f1fb3f tempest-VolumesCloneTest-1996112077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4b7bece2-c702-4f96-8f6b-5c1658189d69" returned: 0 in 0.841s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:38 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5aa18727-3a0e-4fd5-abf8-ea5530f1fb3f tempest-VolumesCloneTest-1996112077 None] Lock "cinder-quobyte-4b7bece2-c702-4f96-8f6b-5c1658189d69" released by "delete_volume" :: held 1.844s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:38 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-5aa18727-3a0e-4fd5-abf8-ea5530f1fb3f tempest-VolumesCloneTest-1996112077 None] Created reservations ['163e3e79-9553-4356-8186-e719216b1a89', '6acde818-c15f-42e7-8f4c-9e35c366309f', '076d498c-5a00-40ee-b7dd-20197f8f3398', '028d20cf-a21a-472b-862b-be93df91d4aa'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5aa18727-3a0e-4fd5-abf8-ea5530f1fb3f tempest-VolumesCloneTest-1996112077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5aa18727-3a0e-4fd5-abf8-ea5530f1fb3f tempest-VolumesCloneTest-1996112077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5aa18727-3a0e-4fd5-abf8-ea5530f1fb3f tempest-VolumesCloneTest-1996112077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5aa18727-3a0e-4fd5-abf8-ea5530f1fb3f tempest-VolumesCloneTest-1996112077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5aa18727-3a0e-4fd5-abf8-ea5530f1fb3f tempest-VolumesCloneTest-1996112077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5aa18727-3a0e-4fd5-abf8-ea5530f1fb3f tempest-VolumesCloneTest-1996112077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:38 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:32:38 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:38 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cfc9907f-1357-4cd5-90a3-884fc27fe44e tempest-GroupSnapshotsTest-1684738746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588" returned: 0 in 0.982s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cfc9907f-1357-4cd5-90a3-884fc27fe44e tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.c891f3cb-bcb8-4976-8d53-6980f69cc10c 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:38 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.c891f3cb-bcb8-4976-8d53-6980f69cc10c 1G Jul 07 17:32:38 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:39 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5aa18727-3a0e-4fd5-abf8-ea5530f1fb3f tempest-VolumesCloneTest-1996112077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.767s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:39 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-5aa18727-3a0e-4fd5-abf8-ea5530f1fb3f tempest-VolumesCloneTest-1996112077 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:32:39 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5aa18727-3a0e-4fd5-abf8-ea5530f1fb3f tempest-VolumesCloneTest-1996112077 None] Deleted volume successfully. Jul 07 17:32:39 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5aa18727-3a0e-4fd5-abf8-ea5530f1fb3f tempest-VolumesCloneTest-1996112077 None] Lock "cinder-4b7bece2-c702-4f96-8f6b-5c1658189d69-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:39 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cfc9907f-1357-4cd5-90a3-884fc27fe44e tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.c891f3cb-bcb8-4976-8d53-6980f69cc10c 1G" returned: 0 in 1.040s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cfc9907f-1357-4cd5-90a3-884fc27fe44e tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.c891f3cb-bcb8-4976-8d53-6980f69cc10c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:39 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.c891f3cb-bcb8-4976-8d53-6980f69cc10c Jul 07 17:32:39 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:40 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cfc9907f-1357-4cd5-90a3-884fc27fe44e tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.c891f3cb-bcb8-4976-8d53-6980f69cc10c" returned: 0 in 0.838s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:40 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-cfc9907f-1357-4cd5-90a3-884fc27fe44e tempest-GroupSnapshotsTest-1684738746 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.c891f3cb-bcb8-4976-8d53-6980f69cc10c is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:32:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cfc9907f-1357-4cd5-90a3-884fc27fe44e tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.c891f3cb-bcb8-4976-8d53-6980f69cc10c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:40 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.c891f3cb-bcb8-4976-8d53-6980f69cc10c Jul 07 17:32:40 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:41 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cfc9907f-1357-4cd5-90a3-884fc27fe44e tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.c891f3cb-bcb8-4976-8d53-6980f69cc10c" returned: 0 in 0.822s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:41 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=100,cinder:INSERT=25,cinder:UPDATE=100,cinder:DELETE=7 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:32:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cfc9907f-1357-4cd5-90a3-884fc27fe44e tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:41 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.info Jul 07 17:32:41 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:42 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:42 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-a7842919-69f0-48e2-a4ae-d9792030b192 req-5783f5fd-4c85-43ef-a904-7d5346b20441 tempest-TestStampPattern-407190565 None] Terminate volume connection completed successfully. Jul 07 17:32:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-a7842919-69f0-48e2-a4ae-d9792030b192 req-5783f5fd-4c85-43ef-a904-7d5346b20441 tempest-TestStampPattern-407190565 None] Deleting attachment 4b8ba4f2-ea7e-4887-ad1d-1757efeb1d96. {{(pid=87303) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:32:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cfc9907f-1357-4cd5-90a3-884fc27fe44e tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.info" returned: 0 in 0.878s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:42 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-cfc9907f-1357-4cd5-90a3-884fc27fe44e tempest-GroupSnapshotsTest-1684738746 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:32:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cfc9907f-1357-4cd5-90a3-884fc27fe44e tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:42 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.info Jul 07 17:32:42 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:43 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cfc9907f-1357-4cd5-90a3-884fc27fe44e tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.info" returned: 0 in 0.773s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-cfc9907f-1357-4cd5-90a3-884fc27fe44e tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.429s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:43 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-cfc9907f-1357-4cd5-90a3-884fc27fe44e tempest-GroupSnapshotsTest-1684738746 None] group_snapshot b70557ba-c66e-438c-a74f-975da8931770: created successfully Jul 07 17:32:44 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-6f05df3d-6f3a-445d-bce7-4a1b7d77c86b tempest-GroupSnapshotsTest-1684738746 None] group_snapshot b70557ba-c66e-438c-a74f-975da8931770: deleting Jul 07 17:32:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6f05df3d-6f3a-445d-bce7-4a1b7d77c86b tempest-GroupSnapshotsTest-1684738746 None] group_snapshot b70557ba-c66e-438c-a74f-975da8931770: deleting {{(pid=87303) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 17:32:44 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6f05df3d-6f3a-445d-bce7-4a1b7d77c86b tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "cinder-quobyte-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:44 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6f05df3d-6f3a-445d-bce7-4a1b7d77c86b tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:44 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6f05df3d-6f3a-445d-bce7-4a1b7d77c86b tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "cinder-quobyte-c891f3cb-bcb8-4976-8d53-6980f69cc10c" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:44 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6f05df3d-6f3a-445d-bce7-4a1b7d77c86b tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-c891f3cb-bcb8-4976-8d53-6980f69cc10c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-6f05df3d-6f3a-445d-bce7-4a1b7d77c86b tempest-GroupSnapshotsTest-1684738746 None] Deleting offline snapshot c891f3cb-bcb8-4976-8d53-6980f69cc10c of volume 9454f5b4-fec4-4fe9-9a99-8f8b75b5f588 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:32:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-6f05df3d-6f3a-445d-bce7-4a1b7d77c86b tempest-GroupSnapshotsTest-1684738746 None] snapshot_file for this snap is: volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.c891f3cb-bcb8-4976-8d53-6980f69cc10c {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:32:44 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bffd462-4e6c-49b0-9440-73548b30e766]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6f05df3d-6f3a-445d-bce7-4a1b7d77c86b tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.c891f3cb-bcb8-4976-8d53-6980f69cc10c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:44 devstack sudo[100885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.c891f3cb-bcb8-4976-8d53-6980f69cc10c Jul 07 17:32:44 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Flow 'volume_create_manager' (16124da3-19f9-4b92-8a11-11cb9fc4f453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda0f241-55a5-4356-8735-e794ae5ab4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:45 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6f05df3d-6f3a-445d-bce7-4a1b7d77c86b tempest-GroupSnapshotsTest-1684738746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.c891f3cb-bcb8-4976-8d53-6980f69cc10c" returned: 0 in 1.060s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-6f05df3d-6f3a-445d-bce7-4a1b7d77c86b tempest-GroupSnapshotsTest-1684738746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda0f241-55a5-4356-8735-e794ae5ab4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1043227689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75307013-a21b-4368-b077-41fb37e9b33e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36eccc06843444fd98464e07922f27a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:45Z,use_quota=True,user_id='d48158e0284b47239bd384756d69162a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380ea07b-c78c-43ba-a5df-83627603d8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380ea07b-c78c-43ba-a5df-83627603d8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e441e8-08a7-494e-894f-469c574096b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e441e8-08a7-494e-894f-469c574096b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75307013-a21b-4368-b077-41fb37e9b33e', 'volume_name': 'volume-75307013-a21b-4368-b077-41fb37e9b33e', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91ac68e6-a138-4908-9765-1fbb1f649828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91ac68e6-a138-4908-9765-1fbb1f649828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60ac5b8-f4c7-4e7b-939d-8c5499e29404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:45 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Volume 75307013-a21b-4368-b077-41fb37e9b33e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75307013-a21b-4368-b077-41fb37e9b33e', 'volume_size': 1} Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1043227689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75307013-a21b-4368-b077-41fb37e9b33e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36eccc06843444fd98464e07922f27a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:32:45Z,use_quota=True,user_id='d48158e0284b47239bd384756d69162a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Creating volume 75307013-a21b-4368-b077-41fb37e9b33e {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:32:45 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad501dff-f327-42b3-a1e0-a899c22998f3]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6f05df3d-6f3a-445d-bce7-4a1b7d77c86b tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:45 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e 1073741824 Jul 07 17:32:45 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:45 devstack sudo[100893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588 Jul 07 17:32:45 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:46 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e 1073741824" returned: 0 in 0.988s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:46 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6f05df3d-6f3a-445d-bce7-4a1b7d77c86b tempest-GroupSnapshotsTest-1684738746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588" returned: 0 in 0.988s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6f05df3d-6f3a-445d-bce7-4a1b7d77c86b tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.c891f3cb-bcb8-4976-8d53-6980f69cc10c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:46 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.c891f3cb-bcb8-4976-8d53-6980f69cc10c Jul 07 17:32:46 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:46 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e Jul 07 17:32:46 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:47 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e" returned: 0 in 0.775s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:32:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60ac5b8-f4c7-4e7b-939d-8c5499e29404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75307013-a21b-4368-b077-41fb37e9b33e', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a842892-c72e-4ab9-b0aa-506e11979bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:32:47 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Volume volume-75307013-a21b-4368-b077-41fb37e9b33e (75307013-a21b-4368-b077-41fb37e9b33e): created successfully Jul 07 17:32:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a842892-c72e-4ab9-b0aa-506e11979bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:32:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Flow 'volume_create_manager' (16124da3-19f9-4b92-8a11-11cb9fc4f453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:32:47 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-16b77904-c6c9-4196-8cc9-670d46fb19af tempest-VolumesSnapshotListTestJSON-1719169125 None] Created volume successfully. Jul 07 17:32:47 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6f05df3d-6f3a-445d-bce7-4a1b7d77c86b tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.c891f3cb-bcb8-4976-8d53-6980f69cc10c" returned: 0 in 1.032s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6f05df3d-6f3a-445d-bce7-4a1b7d77c86b tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.c891f3cb-bcb8-4976-8d53-6980f69cc10c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:47 devstack sudo[100929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.c891f3cb-bcb8-4976-8d53-6980f69cc10c Jul 07 17:32:47 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:48 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6f05df3d-6f3a-445d-bce7-4a1b7d77c86b tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588.c891f3cb-bcb8-4976-8d53-6980f69cc10c" returned: 0 in 1.104s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6f05df3d-6f3a-445d-bce7-4a1b7d77c86b tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-c891f3cb-bcb8-4976-8d53-6980f69cc10c" released by "_delete_snapshot" :: held 4.441s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6f05df3d-6f3a-445d-bce7-4a1b7d77c86b tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588" released by "delete_snapshot" :: held 4.476s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:48 devstack cinder-volume[87303]: WARNING cinder.quota [None req-6f05df3d-6f3a-445d-bce7-4a1b7d77c86b tempest-GroupSnapshotsTest-1684738746 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-765196601 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-765196601, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:32:48 devstack cinder-volume[87303]: WARNING cinder.quota [None req-6f05df3d-6f3a-445d-bce7-4a1b7d77c86b tempest-GroupSnapshotsTest-1684738746 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-765196601 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-765196601, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:32:48 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-6f05df3d-6f3a-445d-bce7-4a1b7d77c86b tempest-GroupSnapshotsTest-1684738746 None] Created reservations ['8caca666-e757-4f7a-aab4-8e87ef21e576', '373aad74-834f-4f35-9848-e44af55fb5f6', '7659997f-67fd-4213-9178-05aeb4f9cee7', '5032a439-0d48-4312-ab78-5196c25c3196'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-92be82da-145a-4e99-af13-cb69c882ec49 tempest-VolumesSnapshotListTestJSON-1719169125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-92be82da-145a-4e99-af13-cb69c882ec49 tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-92be82da-145a-4e99-af13-cb69c882ec49 tempest-VolumesSnapshotListTestJSON-1719169125 None] Creating offline snapshot bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e of volume 75307013-a21b-4368-b077-41fb37e9b33e {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:32:49 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-6f05df3d-6f3a-445d-bce7-4a1b7d77c86b tempest-GroupSnapshotsTest-1684738746 None] group_snapshot b70557ba-c66e-438c-a74f-975da8931770: deleted successfully Jul 07 17:32:49 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca204a0f-2b04-4fcb-99fe-5e734eb45864]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-92be82da-145a-4e99-af13-cb69c882ec49 tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:49 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e Jul 07 17:32:49 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:50 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-92be82da-145a-4e99-af13-cb69c882ec49 tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e" returned: 0 in 0.986s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-92be82da-145a-4e99-af13-cb69c882ec49 tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:50 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e 1G Jul 07 17:32:50 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:50 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e8207c18-1fb4-4284-afed-95d2446a7bdf tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "cinder-quobyte-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:50 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e8207c18-1fb4-4284-afed-95d2446a7bdf tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588" acquired by "delete_volume" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:50 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab7566d-cd45-4111-9a2d-079099bdf08a]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e8207c18-1fb4-4284-afed-95d2446a7bdf tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:50 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588 Jul 07 17:32:50 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:51 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-92be82da-145a-4e99-af13-cb69c882ec49 tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e 1G" returned: 0 in 1.059s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-92be82da-145a-4e99-af13-cb69c882ec49 tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75307013-a21b-4368-b077-41fb37e9b33e -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:51 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75307013-a21b-4368-b077-41fb37e9b33e -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e Jul 07 17:32:51 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:51 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e8207c18-1fb4-4284-afed-95d2446a7bdf tempest-GroupSnapshotsTest-1684738746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588" returned: 0 in 1.007s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e8207c18-1fb4-4284-afed-95d2446a7bdf tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:51 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588 Jul 07 17:32:51 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:52 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-92be82da-145a-4e99-af13-cb69c882ec49 tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75307013-a21b-4368-b077-41fb37e9b33e -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e" returned: 0 in 0.859s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:52 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-92be82da-145a-4e99-af13-cb69c882ec49 tempest-VolumesSnapshotListTestJSON-1719169125 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e is being set with open permissions: ugo+rw Jul 07 17:32:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-92be82da-145a-4e99-af13-cb69c882ec49 tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:52 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e Jul 07 17:32:52 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:52 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e8207c18-1fb4-4284-afed-95d2446a7bdf tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588" returned: 0 in 0.773s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:52 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e8207c18-1fb4-4284-afed-95d2446a7bdf tempest-GroupSnapshotsTest-1684738746 None] Lock "cinder-quobyte-9454f5b4-fec4-4fe9-9a99-8f8b75b5f588" released by "delete_volume" :: held 1.900s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:52 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-e8207c18-1fb4-4284-afed-95d2446a7bdf tempest-GroupSnapshotsTest-1684738746 None] Created reservations ['a0c3bfe1-e064-4475-ab78-29d16e65bd86'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:52 devstack cinder-volume[87303]: WARNING cinder.quota [None req-e8207c18-1fb4-4284-afed-95d2446a7bdf tempest-GroupSnapshotsTest-1684738746 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-765196601 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-765196601, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:32:52 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-e8207c18-1fb4-4284-afed-95d2446a7bdf tempest-GroupSnapshotsTest-1684738746 None] Created reservations ['0d807db2-6525-45f0-982a-c5a0804bc2a1', 'b98e6d45-4262-4b6d-874b-15da2f6e6191', '35bc9a84-a9cb-4953-b27c-3a1ca79cb1cb', 'bed3e9f3-0f25-4f1a-9ffa-1dd35d50eaeb'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e8207c18-1fb4-4284-afed-95d2446a7bdf tempest-GroupSnapshotsTest-1684738746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e8207c18-1fb4-4284-afed-95d2446a7bdf tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:52 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e8207c18-1fb4-4284-afed-95d2446a7bdf tempest-GroupSnapshotsTest-1684738746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:52 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e8207c18-1fb4-4284-afed-95d2446a7bdf tempest-GroupSnapshotsTest-1684738746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e8207c18-1fb4-4284-afed-95d2446a7bdf tempest-GroupSnapshotsTest-1684738746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e8207c18-1fb4-4284-afed-95d2446a7bdf tempest-GroupSnapshotsTest-1684738746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:52 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:32:52 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:52 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-92be82da-145a-4e99-af13-cb69c882ec49 tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e" returned: 0 in 0.838s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-92be82da-145a-4e99-af13-cb69c882ec49 tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:52 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.info Jul 07 17:32:52 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:53 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e8207c18-1fb4-4284-afed-95d2446a7bdf tempest-GroupSnapshotsTest-1684738746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.843s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:53 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-e8207c18-1fb4-4284-afed-95d2446a7bdf tempest-GroupSnapshotsTest-1684738746 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:32:53 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-e8207c18-1fb4-4284-afed-95d2446a7bdf tempest-GroupSnapshotsTest-1684738746 None] Delete group completed successfully. Jul 07 17:32:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-79eaf2e9-e7ea-42ba-a109-6619e4907971 tempest-TestStampPattern-407190565 None] Acquiring lock "cinder-3192418c-5530-4b16-ac83-be8fe92e233f-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-79eaf2e9-e7ea-42ba-a109-6619e4907971 tempest-TestStampPattern-407190565 None] Lock "cinder-3192418c-5530-4b16-ac83-be8fe92e233f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-79eaf2e9-e7ea-42ba-a109-6619e4907971 tempest-TestStampPattern-407190565 None] Acquiring lock "cinder-quobyte-3192418c-5530-4b16-ac83-be8fe92e233f" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-79eaf2e9-e7ea-42ba-a109-6619e4907971 tempest-TestStampPattern-407190565 None] Lock "cinder-quobyte-3192418c-5530-4b16-ac83-be8fe92e233f" acquired by "delete_volume" :: waited 0.027s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:53 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb6e431-8611-4a7a-9333-683632af8042]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-79eaf2e9-e7ea-42ba-a109-6619e4907971 tempest-TestStampPattern-407190565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3192418c-5530-4b16-ac83-be8fe92e233f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:53 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3192418c-5530-4b16-ac83-be8fe92e233f Jul 07 17:32:53 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:53 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-92be82da-145a-4e99-af13-cb69c882ec49 tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.info" returned: 0 in 0.947s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:53 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-92be82da-145a-4e99-af13-cb69c882ec49 tempest-VolumesSnapshotListTestJSON-1719169125 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.info is being set with open permissions: ugo+rw Jul 07 17:32:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-92be82da-145a-4e99-af13-cb69c882ec49 tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:53 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.info Jul 07 17:32:53 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:54 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-92be82da-145a-4e99-af13-cb69c882ec49 tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.info" returned: 0 in 0.854s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-92be82da-145a-4e99-af13-cb69c882ec49 tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.668s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:54 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-79eaf2e9-e7ea-42ba-a109-6619e4907971 tempest-TestStampPattern-407190565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3192418c-5530-4b16-ac83-be8fe92e233f" returned: 0 in 1.039s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-79eaf2e9-e7ea-42ba-a109-6619e4907971 tempest-TestStampPattern-407190565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3192418c-5530-4b16-ac83-be8fe92e233f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:54 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-92be82da-145a-4e99-af13-cb69c882ec49 tempest-VolumesSnapshotListTestJSON-1719169125 None] Create snapshot completed successfully Jul 07 17:32:54 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3192418c-5530-4b16-ac83-be8fe92e233f Jul 07 17:32:54 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6f54980e-f09d-4010-a4cf-7632f3e8011c tempest-VolumesSnapshotListTestJSON-1719169125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:55 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6f54980e-f09d-4010-a4cf-7632f3e8011c tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-79eaf2e9-e7ea-42ba-a109-6619e4907971 tempest-TestStampPattern-407190565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3192418c-5530-4b16-ac83-be8fe92e233f" returned: 0 in 0.936s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:55 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-6f54980e-f09d-4010-a4cf-7632f3e8011c tempest-VolumesSnapshotListTestJSON-1719169125 None] Creating offline snapshot 3d134089-0106-4289-bb6c-5d496d1cc6c9 of volume 75307013-a21b-4368-b077-41fb37e9b33e {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:32:55 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-79eaf2e9-e7ea-42ba-a109-6619e4907971 tempest-TestStampPattern-407190565 None] Lock "cinder-quobyte-3192418c-5530-4b16-ac83-be8fe92e233f" released by "delete_volume" :: held 2.114s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:55 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[9525c4b9-e746-467a-baf2-d01db49b8dbe]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6f54980e-f09d-4010-a4cf-7632f3e8011c tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:55 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-79eaf2e9-e7ea-42ba-a109-6619e4907971 tempest-TestStampPattern-407190565 None] Created reservations ['a90babcd-2bc1-451c-a6bd-018b6ea846a4', 'f4156b0e-4e4b-48c8-8740-bdab42628f9a', '0d17edbe-e77a-4771-8ff0-0512c918be26', '15a61805-2c03-4d16-b18f-4838f49472d0'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:32:55 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e Jul 07 17:32:55 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-79eaf2e9-e7ea-42ba-a109-6619e4907971 tempest-TestStampPattern-407190565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-79eaf2e9-e7ea-42ba-a109-6619e4907971 tempest-TestStampPattern-407190565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-79eaf2e9-e7ea-42ba-a109-6619e4907971 tempest-TestStampPattern-407190565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-79eaf2e9-e7ea-42ba-a109-6619e4907971 tempest-TestStampPattern-407190565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-79eaf2e9-e7ea-42ba-a109-6619e4907971 tempest-TestStampPattern-407190565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-79eaf2e9-e7ea-42ba-a109-6619e4907971 tempest-TestStampPattern-407190565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:56 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:32:56 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:32:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:32:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:32:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:32:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:32:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:56 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:32:56 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:56 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6f54980e-f09d-4010-a4cf-7632f3e8011c tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e" returned: 0 in 1.047s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-6f54980e-f09d-4010-a4cf-7632f3e8011c tempest-VolumesSnapshotListTestJSON-1719169125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75307013-a21b-4368-b077-41fb37e9b33e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:32:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6f54980e-f09d-4010-a4cf-7632f3e8011c tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:56 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9 1G Jul 07 17:32:56 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:57 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-79eaf2e9-e7ea-42ba-a109-6619e4907971 tempest-TestStampPattern-407190565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.991s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-79eaf2e9-e7ea-42ba-a109-6619e4907971 tempest-TestStampPattern-407190565 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:32:57 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-79eaf2e9-e7ea-42ba-a109-6619e4907971 tempest-TestStampPattern-407190565 None] Deleted volume successfully. Jul 07 17:32:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-79eaf2e9-e7ea-42ba-a109-6619e4907971 tempest-TestStampPattern-407190565 None] Lock "cinder-3192418c-5530-4b16-ac83-be8fe92e233f-delete_volume" released by "delete_volume" :: held 3.605s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:32:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-50b201c3-dfb7-4b11-a1aa-9a8900ae6841 tempest-TestStampPattern-407190565 None] Acquiring lock "cinder-02389c7b-b92b-44ac-8825-0e1f5ae0c1ba-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-50b201c3-dfb7-4b11-a1aa-9a8900ae6841 tempest-TestStampPattern-407190565 None] Lock "cinder-02389c7b-b92b-44ac-8825-0e1f5ae0c1ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-50b201c3-dfb7-4b11-a1aa-9a8900ae6841 tempest-TestStampPattern-407190565 None] Acquiring lock "cinder-quobyte-38e9342c-3870-4c66-bb34-7d85667ab9f6" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-50b201c3-dfb7-4b11-a1aa-9a8900ae6841 tempest-TestStampPattern-407190565 None] Lock "cinder-quobyte-38e9342c-3870-4c66-bb34-7d85667ab9f6" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-50b201c3-dfb7-4b11-a1aa-9a8900ae6841 tempest-TestStampPattern-407190565 None] Acquiring lock "cinder-quobyte-02389c7b-b92b-44ac-8825-0e1f5ae0c1ba" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:32:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-50b201c3-dfb7-4b11-a1aa-9a8900ae6841 tempest-TestStampPattern-407190565 None] Lock "cinder-quobyte-02389c7b-b92b-44ac-8825-0e1f5ae0c1ba" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:32:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-50b201c3-dfb7-4b11-a1aa-9a8900ae6841 tempest-TestStampPattern-407190565 None] Deleting offline snapshot 02389c7b-b92b-44ac-8825-0e1f5ae0c1ba of volume 38e9342c-3870-4c66-bb34-7d85667ab9f6 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:32:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-50b201c3-dfb7-4b11-a1aa-9a8900ae6841 tempest-TestStampPattern-407190565 None] snapshot_file for this snap is: volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.02389c7b-b92b-44ac-8825-0e1f5ae0c1ba {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:32:57 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[024d30c3-7abe-46e8-b85d-22ad07250b72]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-50b201c3-dfb7-4b11-a1aa-9a8900ae6841 tempest-TestStampPattern-407190565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.02389c7b-b92b-44ac-8825-0e1f5ae0c1ba {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:57 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.041s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:32:57 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:32:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:32:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:32:57 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.02389c7b-b92b-44ac-8825-0e1f5ae0c1ba Jul 07 17:32:57 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:58 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6f54980e-f09d-4010-a4cf-7632f3e8011c tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9 1G" returned: 0 in 1.225s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6f54980e-f09d-4010-a4cf-7632f3e8011c tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:58 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9 Jul 07 17:32:58 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:58 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-50b201c3-dfb7-4b11-a1aa-9a8900ae6841 tempest-TestStampPattern-407190565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.02389c7b-b92b-44ac-8825-0e1f5ae0c1ba" returned: 0 in 0.944s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:58 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-50b201c3-dfb7-4b11-a1aa-9a8900ae6841 tempest-TestStampPattern-407190565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38e9342c-3870-4c66-bb34-7d85667ab9f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:32:58 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed602db0-2941-4d32-8554-05e8b5a3899d]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:32:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-50b201c3-dfb7-4b11-a1aa-9a8900ae6841 tempest-TestStampPattern-407190565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:58 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 Jul 07 17:32:58 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:58 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6f54980e-f09d-4010-a4cf-7632f3e8011c tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9" returned: 0 in 0.829s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:58 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-6f54980e-f09d-4010-a4cf-7632f3e8011c tempest-VolumesSnapshotListTestJSON-1719169125 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9 is being set with open permissions: ugo+rw Jul 07 17:32:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6f54980e-f09d-4010-a4cf-7632f3e8011c tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:58 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9 Jul 07 17:32:58 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:59 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-50b201c3-dfb7-4b11-a1aa-9a8900ae6841 tempest-TestStampPattern-407190565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6" returned: 0 in 0.905s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-50b201c3-dfb7-4b11-a1aa-9a8900ae6841 tempest-TestStampPattern-407190565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.02389c7b-b92b-44ac-8825-0e1f5ae0c1ba {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:32:59 devstack sudo[101063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.02389c7b-b92b-44ac-8825-0e1f5ae0c1ba Jul 07 17:32:59 devstack sudo[101063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:32:59 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-83155d96-c629-46fb-ba4a-7729ab7c8f41 tempest-GroupsV314Test-1121392188 None] Group tempest-GroupsV314Test-Group-1976596450: creating Jul 07 17:32:59 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Jul 07 17:32:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6f54980e-f09d-4010-a4cf-7632f3e8011c tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9" returned: 0 in 0.789s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:32:59 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-83155d96-c629-46fb-ba4a-7729ab7c8f41 tempest-GroupsV314Test-1121392188 None] Group tempest-GroupsV314Test-Group-1976596450: created successfully Jul 07 17:32:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6f54980e-f09d-4010-a4cf-7632f3e8011c tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.076s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:32:59 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-83155d96-c629-46fb-ba4a-7729ab7c8f41 tempest-GroupsV314Test-1121392188 None] Create group completed successfully. Jul 07 17:32:59 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-6f54980e-f09d-4010-a4cf-7632f3e8011c tempest-VolumesSnapshotListTestJSON-1719169125 None] Create snapshot completed successfully Jul 07 17:33:00 devstack sudo[101063]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-50b201c3-dfb7-4b11-a1aa-9a8900ae6841 tempest-TestStampPattern-407190565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.02389c7b-b92b-44ac-8825-0e1f5ae0c1ba" returned: 0 in 0.898s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-50b201c3-dfb7-4b11-a1aa-9a8900ae6841 tempest-TestStampPattern-407190565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.02389c7b-b92b-44ac-8825-0e1f5ae0c1ba {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:00 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.02389c7b-b92b-44ac-8825-0e1f5ae0c1ba Jul 07 17:33:00 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:01 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-50b201c3-dfb7-4b11-a1aa-9a8900ae6841 tempest-TestStampPattern-407190565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6.02389c7b-b92b-44ac-8825-0e1f5ae0c1ba" returned: 0 in 0.817s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0ae0c5bc-329d-48fb-afda-16a684ef8f56 tempest-VolumesSnapshotListTestJSON-1719169125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0ae0c5bc-329d-48fb-afda-16a684ef8f56 tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-0ae0c5bc-329d-48fb-afda-16a684ef8f56 tempest-VolumesSnapshotListTestJSON-1719169125 None] Creating offline snapshot dd9df480-35cc-4b06-a2b2-663e66a2854a of volume 75307013-a21b-4368-b077-41fb37e9b33e {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:33:01 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d23d0f8-9d07-4734-b5ce-a10df2aa3533]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0ae0c5bc-329d-48fb-afda-16a684ef8f56 tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-50b201c3-dfb7-4b11-a1aa-9a8900ae6841 tempest-TestStampPattern-407190565 None] Lock "cinder-quobyte-02389c7b-b92b-44ac-8825-0e1f5ae0c1ba" released by "_delete_snapshot" :: held 3.810s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-50b201c3-dfb7-4b11-a1aa-9a8900ae6841 tempest-TestStampPattern-407190565 None] Lock "cinder-quobyte-38e9342c-3870-4c66-bb34-7d85667ab9f6" released by "delete_snapshot" :: held 3.872s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:01 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:01 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9 Jul 07 17:33:01 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Flow 'volume_create_manager' (5e15cdf3-3d0b-4542-aa62-e94815fa9022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002b7467-d7b5-4e3d-a275-c8e900b3dcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002b7467-d7b5-4e3d-a275-c8e900b3dcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-47201177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2af89b21-c9f1-46ce-9668-ce33501e6776,host='devstack@QuobyteHD#QuobyteHD',id=cb2f18a5-7951-4482-a798-34c9101f51c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a19e165cacf74457af3194fc30e26cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:01Z,use_quota=True,user_id='ada32de717e847b082e59f2441a628be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a91362f-d688-46d7-88f8-48331b28f3a9),volume_type_id=0a91362f-d688-46d7-88f8-48331b28f3a9)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18acd4bd-c257-47ad-ac99-620f8e281eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18acd4bd-c257-47ad-ac99-620f8e281eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be86bee-5def-4aab-a721-4eb0926cb53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be86bee-5def-4aab-a721-4eb0926cb53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb2f18a5-7951-4482-a798-34c9101f51c0', 'volume_name': 'volume-cb2f18a5-7951-4482-a798-34c9101f51c0', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea031a75-4302-4f24-880b-4f9c59fc973c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea031a75-4302-4f24-880b-4f9c59fc973c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6dde54f-5878-44b5-b6f4-688237efac6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:01 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Volume cb2f18a5-7951-4482-a798-34c9101f51c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb2f18a5-7951-4482-a798-34c9101f51c0', 'volume_size': 1} Jul 07 17:33:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:01 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-50b201c3-dfb7-4b11-a1aa-9a8900ae6841 tempest-TestStampPattern-407190565 None] Created reservations ['d973e3a6-fdaa-431a-8091-d392c2f972e0', 'f51945e2-8e66-497e-9265-5229ce650a1c', '3ac518e9-9f37-4004-b03d-094f6c953a7c', 'f70d484a-9d89-4891-847b-89383f8f4886'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:01 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-50b201c3-dfb7-4b11-a1aa-9a8900ae6841 tempest-TestStampPattern-407190565 None] Delete snapshot completed successfully. Jul 07 17:33:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-50b201c3-dfb7-4b11-a1aa-9a8900ae6841 tempest-TestStampPattern-407190565 None] Lock "cinder-02389c7b-b92b-44ac-8825-0e1f5ae0c1ba-delete_snapshot" released by "delete_snapshot" :: held 4.232s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:02 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0ae0c5bc-329d-48fb-afda-16a684ef8f56 tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9" returned: 0 in 1.017s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:02 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-0ae0c5bc-329d-48fb-afda-16a684ef8f56 tempest-VolumesSnapshotListTestJSON-1719169125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75307013-a21b-4368-b077-41fb37e9b33e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:33:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0ae0c5bc-329d-48fb-afda-16a684ef8f56 tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.dd9df480-35cc-4b06-a2b2-663e66a2854a 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:02 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.dd9df480-35cc-4b06-a2b2-663e66a2854a 1G Jul 07 17:33:02 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:03 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0ae0c5bc-329d-48fb-afda-16a684ef8f56 tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.dd9df480-35cc-4b06-a2b2-663e66a2854a 1G" returned: 0 in 1.174s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0ae0c5bc-329d-48fb-afda-16a684ef8f56 tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.dd9df480-35cc-4b06-a2b2-663e66a2854a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:03 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.dd9df480-35cc-4b06-a2b2-663e66a2854a Jul 07 17:33:03 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:04 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0ae0c5bc-329d-48fb-afda-16a684ef8f56 tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.dd9df480-35cc-4b06-a2b2-663e66a2854a" returned: 0 in 0.844s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:04 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-0ae0c5bc-329d-48fb-afda-16a684ef8f56 tempest-VolumesSnapshotListTestJSON-1719169125 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.dd9df480-35cc-4b06-a2b2-663e66a2854a is being set with open permissions: ugo+rw Jul 07 17:33:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0ae0c5bc-329d-48fb-afda-16a684ef8f56 tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.dd9df480-35cc-4b06-a2b2-663e66a2854a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:04 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.dd9df480-35cc-4b06-a2b2-663e66a2854a Jul 07 17:33:04 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:05 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0ae0c5bc-329d-48fb-afda-16a684ef8f56 tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.dd9df480-35cc-4b06-a2b2-663e66a2854a" returned: 0 in 0.896s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0ae0c5bc-329d-48fb-afda-16a684ef8f56 tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.106s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.729s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2af89b21-c9f1-46ce-9668-ce33501e6776,created_at=2026-07-07T15:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-47201177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2af89b21-c9f1-46ce-9668-ce33501e6776,host='devstack@QuobyteHD#QuobyteHD',id=cb2f18a5-7951-4482-a798-34c9101f51c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a19e165cacf74457af3194fc30e26cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:01Z,use_quota=True,user_id='ada32de717e847b082e59f2441a628be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a91362f-d688-46d7-88f8-48331b28f3a9),volume_type_id=0a91362f-d688-46d7-88f8-48331b28f3a9)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Creating volume cb2f18a5-7951-4482-a798-34c9101f51c0 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:05 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:33:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:05 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0 1073741824 Jul 07 17:33:05 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:05 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-0ae0c5bc-329d-48fb-afda-16a684ef8f56 tempest-VolumesSnapshotListTestJSON-1719169125 None] Create snapshot completed successfully Jul 07 17:33:06 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0 1073741824" returned: 0 in 1.090s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:06 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:UPDATE=109,cinder:SELECT=95,cinder:INSERT=27,cinder:DELETE=6 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:33:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:06 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0 Jul 07 17:33:06 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:07 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0" returned: 0 in 0.823s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] <== create_volume: return (1969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6dde54f-5878-44b5-b6f4-688237efac6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb2f18a5-7951-4482-a798-34c9101f51c0', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda45736-3de7-4e37-8071-54d7cf9468e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:07 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Volume volume-cb2f18a5-7951-4482-a798-34c9101f51c0 (cb2f18a5-7951-4482-a798-34c9101f51c0): created successfully Jul 07 17:33:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda45736-3de7-4e37-8071-54d7cf9468e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Flow 'volume_create_manager' (5e15cdf3-3d0b-4542-aa62-e94815fa9022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:07 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-df2713ad-5c8e-4c54-b76a-bd0c962fc742 tempest-GroupsV314Test-1121392188 None] Created volume successfully. Jul 07 17:33:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8805f54d-06a2-4d9c-8d2d-137939665b96 tempest-VolumesSnapshotListTestJSON-1719169125 None] Acquiring lock "cinder-dd9df480-35cc-4b06-a2b2-663e66a2854a-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8805f54d-06a2-4d9c-8d2d-137939665b96 tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "cinder-dd9df480-35cc-4b06-a2b2-663e66a2854a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8805f54d-06a2-4d9c-8d2d-137939665b96 tempest-VolumesSnapshotListTestJSON-1719169125 None] Acquiring lock "cinder-quobyte-75307013-a21b-4368-b077-41fb37e9b33e" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8805f54d-06a2-4d9c-8d2d-137939665b96 tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "cinder-quobyte-75307013-a21b-4368-b077-41fb37e9b33e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8805f54d-06a2-4d9c-8d2d-137939665b96 tempest-VolumesSnapshotListTestJSON-1719169125 None] Acquiring lock "cinder-quobyte-dd9df480-35cc-4b06-a2b2-663e66a2854a" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8805f54d-06a2-4d9c-8d2d-137939665b96 tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "cinder-quobyte-dd9df480-35cc-4b06-a2b2-663e66a2854a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-8805f54d-06a2-4d9c-8d2d-137939665b96 tempest-VolumesSnapshotListTestJSON-1719169125 None] Deleting offline snapshot dd9df480-35cc-4b06-a2b2-663e66a2854a of volume 75307013-a21b-4368-b077-41fb37e9b33e {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:33:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-8805f54d-06a2-4d9c-8d2d-137939665b96 tempest-VolumesSnapshotListTestJSON-1719169125 None] snapshot_file for this snap is: volume-75307013-a21b-4368-b077-41fb37e9b33e.dd9df480-35cc-4b06-a2b2-663e66a2854a {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:33:07 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b52f20-4285-4356-9201-ea510e8a44ab]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8805f54d-06a2-4d9c-8d2d-137939665b96 tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.dd9df480-35cc-4b06-a2b2-663e66a2854a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:07 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.dd9df480-35cc-4b06-a2b2-663e66a2854a Jul 07 17:33:07 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:08 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8805f54d-06a2-4d9c-8d2d-137939665b96 tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.dd9df480-35cc-4b06-a2b2-663e66a2854a" returned: 0 in 0.943s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-8805f54d-06a2-4d9c-8d2d-137939665b96 tempest-VolumesSnapshotListTestJSON-1719169125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75307013-a21b-4368-b077-41fb37e9b33e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:33:08 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb068336-1bbe-492a-83eb-c73f8bb55814]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8805f54d-06a2-4d9c-8d2d-137939665b96 tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:08 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9 Jul 07 17:33:08 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:08 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Cloning volume cb2f18a5-7951-4482-a798-34c9101f51c0 to volume fd389f59-8c2f-4fb1-8e48-227a20c8b305 Jul 07 17:33:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Creating offline snapshot 04928ac4-2f7a-481e-a4c0-e673605ae00d of volume cb2f18a5-7951-4482-a798-34c9101f51c0 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:33:08 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[1399008a-6b59-4df8-88aa-7559c41397f0]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:09 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0 Jul 07 17:33:09 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:09 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8805f54d-06a2-4d9c-8d2d-137939665b96 tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9" returned: 0 in 0.970s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:09 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-8805f54d-06a2-4d9c-8d2d-137939665b96 tempest-VolumesSnapshotListTestJSON-1719169125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75307013-a21b-4368-b077-41fb37e9b33e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:33:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8805f54d-06a2-4d9c-8d2d-137939665b96 tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.dd9df480-35cc-4b06-a2b2-663e66a2854a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:09 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.dd9df480-35cc-4b06-a2b2-663e66a2854a Jul 07 17:33:09 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:09 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0" returned: 0 in 1.030s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.04928ac4-2f7a-481e-a4c0-e673605ae00d 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:10 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.04928ac4-2f7a-481e-a4c0-e673605ae00d 1G Jul 07 17:33:10 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:10 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8805f54d-06a2-4d9c-8d2d-137939665b96 tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.dd9df480-35cc-4b06-a2b2-663e66a2854a" returned: 0 in 0.987s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8805f54d-06a2-4d9c-8d2d-137939665b96 tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.dd9df480-35cc-4b06-a2b2-663e66a2854a {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:10 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.dd9df480-35cc-4b06-a2b2-663e66a2854a Jul 07 17:33:10 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f470e698-7071-4a93-8201-1a8847f38814 tempest-TestStampPattern-407190565 None] Acquiring lock "cinder-38e9342c-3870-4c66-bb34-7d85667ab9f6-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f470e698-7071-4a93-8201-1a8847f38814 tempest-TestStampPattern-407190565 None] Lock "cinder-38e9342c-3870-4c66-bb34-7d85667ab9f6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:10 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.04928ac4-2f7a-481e-a4c0-e673605ae00d 1G" returned: 0 in 0.959s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb2f18a5-7951-4482-a798-34c9101f51c0 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.04928ac4-2f7a-481e-a4c0-e673605ae00d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:10 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb2f18a5-7951-4482-a798-34c9101f51c0 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.04928ac4-2f7a-481e-a4c0-e673605ae00d Jul 07 17:33:10 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f470e698-7071-4a93-8201-1a8847f38814 tempest-TestStampPattern-407190565 None] Acquiring lock "cinder-quobyte-38e9342c-3870-4c66-bb34-7d85667ab9f6" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f470e698-7071-4a93-8201-1a8847f38814 tempest-TestStampPattern-407190565 None] Lock "cinder-quobyte-38e9342c-3870-4c66-bb34-7d85667ab9f6" acquired by "delete_volume" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:11 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[076e167f-82db-4898-a05b-fe2c30d8fefc]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f470e698-7071-4a93-8201-1a8847f38814 tempest-TestStampPattern-407190565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:11 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 Jul 07 17:33:11 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:11 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8805f54d-06a2-4d9c-8d2d-137939665b96 tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.dd9df480-35cc-4b06-a2b2-663e66a2854a" returned: 0 in 0.837s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8805f54d-06a2-4d9c-8d2d-137939665b96 tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "cinder-quobyte-dd9df480-35cc-4b06-a2b2-663e66a2854a" released by "_delete_snapshot" :: held 3.863s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8805f54d-06a2-4d9c-8d2d-137939665b96 tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "cinder-quobyte-75307013-a21b-4368-b077-41fb37e9b33e" released by "delete_snapshot" :: held 3.897s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:11 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-8805f54d-06a2-4d9c-8d2d-137939665b96 tempest-VolumesSnapshotListTestJSON-1719169125 None] Created reservations ['156541d1-fe69-4992-ba24-beb219ac0601', 'a301d6c2-7a8b-4400-8ee7-8d792e0f363a', '15f8f7af-e7f5-423a-9bec-1f6b5b04489a', '9a39a6d4-c3b4-40b2-9e96-06105e08a2f4'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:11 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-8805f54d-06a2-4d9c-8d2d-137939665b96 tempest-VolumesSnapshotListTestJSON-1719169125 None] Delete snapshot completed successfully. Jul 07 17:33:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8805f54d-06a2-4d9c-8d2d-137939665b96 tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "cinder-dd9df480-35cc-4b06-a2b2-663e66a2854a-delete_snapshot" released by "delete_snapshot" :: held 4.102s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:11 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9cc88afa-6968-4fa3-bd90-310f4ce5ff27 tempest-VolumesSnapshotListTestJSON-1719169125 None] Acquiring lock "cinder-3d134089-0106-4289-bb6c-5d496d1cc6c9-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb2f18a5-7951-4482-a798-34c9101f51c0 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.04928ac4-2f7a-481e-a4c0-e673605ae00d" returned: 0 in 0.901s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:11 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.04928ac4-2f7a-481e-a4c0-e673605ae00d is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:33:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.04928ac4-2f7a-481e-a4c0-e673605ae00d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9cc88afa-6968-4fa3-bd90-310f4ce5ff27 tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "cinder-3d134089-0106-4289-bb6c-5d496d1cc6c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9cc88afa-6968-4fa3-bd90-310f4ce5ff27 tempest-VolumesSnapshotListTestJSON-1719169125 None] Acquiring lock "cinder-quobyte-75307013-a21b-4368-b077-41fb37e9b33e" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:11 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.04928ac4-2f7a-481e-a4c0-e673605ae00d Jul 07 17:33:11 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9cc88afa-6968-4fa3-bd90-310f4ce5ff27 tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "cinder-quobyte-75307013-a21b-4368-b077-41fb37e9b33e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9cc88afa-6968-4fa3-bd90-310f4ce5ff27 tempest-VolumesSnapshotListTestJSON-1719169125 None] Acquiring lock "cinder-quobyte-3d134089-0106-4289-bb6c-5d496d1cc6c9" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9cc88afa-6968-4fa3-bd90-310f4ce5ff27 tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "cinder-quobyte-3d134089-0106-4289-bb6c-5d496d1cc6c9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-9cc88afa-6968-4fa3-bd90-310f4ce5ff27 tempest-VolumesSnapshotListTestJSON-1719169125 None] Deleting offline snapshot 3d134089-0106-4289-bb6c-5d496d1cc6c9 of volume 75307013-a21b-4368-b077-41fb37e9b33e {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:33:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-9cc88afa-6968-4fa3-bd90-310f4ce5ff27 tempest-VolumesSnapshotListTestJSON-1719169125 None] snapshot_file for this snap is: volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:33:11 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b6612e-cc79-49b9-89aa-3490020eb5b5]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9cc88afa-6968-4fa3-bd90-310f4ce5ff27 tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:12 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f470e698-7071-4a93-8201-1a8847f38814 tempest-TestStampPattern-407190565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6" returned: 0 in 0.975s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f470e698-7071-4a93-8201-1a8847f38814 tempest-TestStampPattern-407190565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:12 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6 Jul 07 17:33:12 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:12 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9 Jul 07 17:33:12 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:12 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.04928ac4-2f7a-481e-a4c0-e673605ae00d" returned: 0 in 0.848s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:12 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.info Jul 07 17:33:12 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:12 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:12 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9cc88afa-6968-4fa3-bd90-310f4ce5ff27 tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9" returned: 0 in 0.854s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-9cc88afa-6968-4fa3-bd90-310f4ce5ff27 tempest-VolumesSnapshotListTestJSON-1719169125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75307013-a21b-4368-b077-41fb37e9b33e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:33:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f470e698-7071-4a93-8201-1a8847f38814 tempest-TestStampPattern-407190565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-38e9342c-3870-4c66-bb34-7d85667ab9f6" returned: 0 in 0.831s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:12 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[becd399d-024d-497e-9aaf-07d2e832b9a8]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9cc88afa-6968-4fa3-bd90-310f4ce5ff27 tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:12 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f470e698-7071-4a93-8201-1a8847f38814 tempest-TestStampPattern-407190565 None] Lock "cinder-quobyte-38e9342c-3870-4c66-bb34-7d85667ab9f6" released by "delete_volume" :: held 1.910s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:12 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-f470e698-7071-4a93-8201-1a8847f38814 tempest-TestStampPattern-407190565 None] Created reservations ['3593e12b-9089-43d9-b057-ebf28ede52c4', '1cbf303c-26ab-4632-b7e5-286d85bfda19', 'd5f2b149-73a5-428e-adde-0a603e1b0210', 'aa77b670-745f-4da6-8b05-5bd39dbfef8c'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:13 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e Jul 07 17:33:13 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f470e698-7071-4a93-8201-1a8847f38814 tempest-TestStampPattern-407190565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f470e698-7071-4a93-8201-1a8847f38814 tempest-TestStampPattern-407190565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f470e698-7071-4a93-8201-1a8847f38814 tempest-TestStampPattern-407190565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f470e698-7071-4a93-8201-1a8847f38814 tempest-TestStampPattern-407190565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f470e698-7071-4a93-8201-1a8847f38814 tempest-TestStampPattern-407190565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f470e698-7071-4a93-8201-1a8847f38814 tempest-TestStampPattern-407190565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:13 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:33:13 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:13 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.info" returned: 0 in 0.845s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:13 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:33:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:13 devstack sudo[101186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.info Jul 07 17:33:13 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:13 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f470e698-7071-4a93-8201-1a8847f38814 tempest-TestStampPattern-407190565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.872s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:13 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-f470e698-7071-4a93-8201-1a8847f38814 tempest-TestStampPattern-407190565 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:14 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-f470e698-7071-4a93-8201-1a8847f38814 tempest-TestStampPattern-407190565 None] Deleted volume successfully. Jul 07 17:33:14 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f470e698-7071-4a93-8201-1a8847f38814 tempest-TestStampPattern-407190565 None] Lock "cinder-38e9342c-3870-4c66-bb34-7d85667ab9f6-delete_volume" released by "delete_volume" :: held 3.131s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:14 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9cc88afa-6968-4fa3-bd90-310f4ce5ff27 tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e" returned: 0 in 1.181s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-9cc88afa-6968-4fa3-bd90-310f4ce5ff27 tempest-VolumesSnapshotListTestJSON-1719169125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75307013-a21b-4368-b077-41fb37e9b33e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:33:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9cc88afa-6968-4fa3-bd90-310f4ce5ff27 tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:14 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9 Jul 07 17:33:14 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:14 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.info" returned: 0 in 0.958s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:14 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Acquiring lock "cinder-quobyte-fd389f59-8c2f-4fb1-8e48-227a20c8b305" by "_copy_volume_from_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:14 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Lock "cinder-quobyte-fd389f59-8c2f-4fb1-8e48-227a20c8b305" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] snapshot: 04928ac4-2f7a-481e-a4c0-e673605ae00d, volume: fd389f59-8c2f-4fb1-8e48-227a20c8b305, {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:33:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:14 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5caadf-7c15-42f3-84b2-bbff18baa2de]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.04928ac4-2f7a-481e-a4c0-e673605ae00d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:14 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.04928ac4-2f7a-481e-a4c0-e673605ae00d Jul 07 17:33:14 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:15 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9cc88afa-6968-4fa3-bd90-310f4ce5ff27 tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9" returned: 0 in 1.011s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9cc88afa-6968-4fa3-bd90-310f4ce5ff27 tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:15 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9 Jul 07 17:33:15 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:15 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.04928ac4-2f7a-481e-a4c0-e673605ae00d" returned: 0 in 0.989s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb2f18a5-7951-4482-a798-34c9101f51c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:33:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0 {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:33:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Creating direct copy from snapshot {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:33:15 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[e668bfb2-8b70-42a9-90af-fa4ff65c285c]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:15 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0 Jul 07 17:33:15 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:15 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9cc88afa-6968-4fa3-bd90-310f4ce5ff27 tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.3d134089-0106-4289-bb6c-5d496d1cc6c9" returned: 0 in 0.887s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:16 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9cc88afa-6968-4fa3-bd90-310f4ce5ff27 tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "cinder-quobyte-3d134089-0106-4289-bb6c-5d496d1cc6c9" released by "_delete_snapshot" :: held 4.089s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:16 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9cc88afa-6968-4fa3-bd90-310f4ce5ff27 tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "cinder-quobyte-75307013-a21b-4368-b077-41fb37e9b33e" released by "delete_snapshot" :: held 4.118s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:16 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-9cc88afa-6968-4fa3-bd90-310f4ce5ff27 tempest-VolumesSnapshotListTestJSON-1719169125 None] Created reservations ['fa04a154-f65e-4597-9a1f-149c2fb1fcf6', 'd82fa7ea-e840-41cf-962b-e34e490b74c8', '3afd7cf0-a234-4f8e-a4a9-6ddb6a88c296', '9628834f-3063-4210-b6ff-ca2c1c39c2b1'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:16 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-9cc88afa-6968-4fa3-bd90-310f4ce5ff27 tempest-VolumesSnapshotListTestJSON-1719169125 None] Delete snapshot completed successfully. Jul 07 17:33:16 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-9cc88afa-6968-4fa3-bd90-310f4ce5ff27 tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "cinder-3d134089-0106-4289-bb6c-5d496d1cc6c9-delete_snapshot" released by "delete_snapshot" :: held 4.332s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:16 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0" returned: 0 in 1.006s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:16 devstack cinder-volume[87303]: DEBUG cinder.utils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Path /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fd389f59-8c2f-4fb1-8e48-227a20c8b305 not found in is_blk_device check {{(pid=87303) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:33:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fd389f59-8c2f-4fb1-8e48-227a20c8b305 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:16 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fd389f59-8c2f-4fb1-8e48-227a20c8b305 Jul 07 17:33:16 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d656e45c-c0dc-4585-ac7c-a52c6ce342bb tempest-VolumesSnapshotListTestJSON-1719169125 None] Acquiring lock "cinder-bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d656e45c-c0dc-4585-ac7c-a52c6ce342bb tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "cinder-bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d656e45c-c0dc-4585-ac7c-a52c6ce342bb tempest-VolumesSnapshotListTestJSON-1719169125 None] Acquiring lock "cinder-quobyte-75307013-a21b-4368-b077-41fb37e9b33e" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d656e45c-c0dc-4585-ac7c-a52c6ce342bb tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "cinder-quobyte-75307013-a21b-4368-b077-41fb37e9b33e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d656e45c-c0dc-4585-ac7c-a52c6ce342bb tempest-VolumesSnapshotListTestJSON-1719169125 None] Acquiring lock "cinder-quobyte-bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d656e45c-c0dc-4585-ac7c-a52c6ce342bb tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "cinder-quobyte-bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-d656e45c-c0dc-4585-ac7c-a52c6ce342bb tempest-VolumesSnapshotListTestJSON-1719169125 None] Deleting offline snapshot bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e of volume 75307013-a21b-4368-b077-41fb37e9b33e {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:33:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-d656e45c-c0dc-4585-ac7c-a52c6ce342bb tempest-VolumesSnapshotListTestJSON-1719169125 None] snapshot_file for this snap is: volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:33:17 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[142c6be3-ab6f-4cab-8669-a425c5cad887]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d656e45c-c0dc-4585-ac7c-a52c6ce342bb tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:17 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e Jul 07 17:33:17 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:19 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d656e45c-c0dc-4585-ac7c-a52c6ce342bb tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e" returned: 0 in 1.995s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-d656e45c-c0dc-4585-ac7c-a52c6ce342bb tempest-VolumesSnapshotListTestJSON-1719169125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75307013-a21b-4368-b077-41fb37e9b33e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:33:19 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdaea93-6769-40e4-a9bc-c3a353b66a79]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d656e45c-c0dc-4585-ac7c-a52c6ce342bb tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:19 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e Jul 07 17:33:19 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:21 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d656e45c-c0dc-4585-ac7c-a52c6ce342bb tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e" returned: 0 in 2.092s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d656e45c-c0dc-4585-ac7c-a52c6ce342bb tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:21 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e Jul 07 17:33:21 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:23 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fd389f59-8c2f-4fb1-8e48-227a20c8b305" returned: 0 in 6.571s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:23 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[67440ab9-6c95-4dd3-a4e7-49135018c7d0]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:23 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d656e45c-c0dc-4585-ac7c-a52c6ce342bb tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e" returned: 0 in 1.797s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d656e45c-c0dc-4585-ac7c-a52c6ce342bb tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:23 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e Jul 07 17:33:23 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:23 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0 Jul 07 17:33:23 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:24 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d656e45c-c0dc-4585-ac7c-a52c6ce342bb tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e.bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e" returned: 0 in 0.821s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d656e45c-c0dc-4585-ac7c-a52c6ce342bb tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "cinder-quobyte-bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e" released by "_delete_snapshot" :: held 6.917s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d656e45c-c0dc-4585-ac7c-a52c6ce342bb tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "cinder-quobyte-75307013-a21b-4368-b077-41fb37e9b33e" released by "delete_snapshot" :: held 6.946s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:24 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-d656e45c-c0dc-4585-ac7c-a52c6ce342bb tempest-VolumesSnapshotListTestJSON-1719169125 None] Created reservations ['eafc4f87-e598-443a-b64b-e869c892e50c', 'c81935bb-0a17-4b6f-abe5-48b32fa55746', 'af599bdd-1f61-488d-a3d6-7c4b783c247a', '941f7ec7-b62c-4e5e-bd60-1661fabe2190'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:24 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-d656e45c-c0dc-4585-ac7c-a52c6ce342bb tempest-VolumesSnapshotListTestJSON-1719169125 None] Delete snapshot completed successfully. Jul 07 17:33:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d656e45c-c0dc-4585-ac7c-a52c6ce342bb tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "cinder-bd1aa5d0-7c4c-46bb-b8ef-5ab55421842e-delete_snapshot" released by "delete_snapshot" :: held 7.146s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:24 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0" returned: 0 in 1.231s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:24 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Image conversion details: src /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0, size 1024.00 MB, duration 6.57 sec, destination /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fd389f59-8c2f-4fb1-8e48-227a20c8b305 {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:33:24 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Converted 1024.00 MB image at 155.81 MB/s Jul 07 17:33:24 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fd389f59-8c2f-4fb1-8e48-227a20c8b305 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:33:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fd389f59-8c2f-4fb1-8e48-227a20c8b305 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:24 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fd389f59-8c2f-4fb1-8e48-227a20c8b305 Jul 07 17:33:24 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0a5ec7c3-2975-47de-8460-f5edc564c95e tempest-VolumesSnapshotListTestJSON-1719169125 None] Acquiring lock "cinder-75307013-a21b-4368-b077-41fb37e9b33e-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0a5ec7c3-2975-47de-8460-f5edc564c95e tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "cinder-75307013-a21b-4368-b077-41fb37e9b33e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0a5ec7c3-2975-47de-8460-f5edc564c95e tempest-VolumesSnapshotListTestJSON-1719169125 None] Acquiring lock "cinder-quobyte-75307013-a21b-4368-b077-41fb37e9b33e" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0a5ec7c3-2975-47de-8460-f5edc564c95e tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "cinder-quobyte-75307013-a21b-4368-b077-41fb37e9b33e" acquired by "delete_volume" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:25 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d383470d-0915-49cc-b3d9-b1fb0b0b0d52]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0a5ec7c3-2975-47de-8460-f5edc564c95e tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:25 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e Jul 07 17:33:25 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:25 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fd389f59-8c2f-4fb1-8e48-227a20c8b305" returned: 0 in 0.800s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Lock "cinder-quobyte-fd389f59-8c2f-4fb1-8e48-227a20c8b305" released by "_copy_volume_from_snapshot" :: held 10.714s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Acquiring lock "cinder-quobyte-04928ac4-2f7a-481e-a4c0-e673605ae00d" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Lock "cinder-quobyte-04928ac4-2f7a-481e-a4c0-e673605ae00d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Deleting offline snapshot 04928ac4-2f7a-481e-a4c0-e673605ae00d of volume cb2f18a5-7951-4482-a798-34c9101f51c0 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:33:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] snapshot_file for this snap is: volume-cb2f18a5-7951-4482-a798-34c9101f51c0.04928ac4-2f7a-481e-a4c0-e673605ae00d {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:33:25 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46032a9-de6c-422c-aa47-9b00a491f9e0]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.04928ac4-2f7a-481e-a4c0-e673605ae00d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:25 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.04928ac4-2f7a-481e-a4c0-e673605ae00d Jul 07 17:33:25 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:26 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0a5ec7c3-2975-47de-8460-f5edc564c95e tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e" returned: 0 in 1.164s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0a5ec7c3-2975-47de-8460-f5edc564c95e tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:26 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e Jul 07 17:33:26 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:26 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.04928ac4-2f7a-481e-a4c0-e673605ae00d" returned: 0 in 1.014s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:26 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb2f18a5-7951-4482-a798-34c9101f51c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:33:26 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b4ea82-7bfd-44eb-a8a3-2df907e8c4ab]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:26 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0 Jul 07 17:33:26 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:27 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0a5ec7c3-2975-47de-8460-f5edc564c95e tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-75307013-a21b-4368-b077-41fb37e9b33e" returned: 0 in 0.881s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0a5ec7c3-2975-47de-8460-f5edc564c95e tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "cinder-quobyte-75307013-a21b-4368-b077-41fb37e9b33e" released by "delete_volume" :: held 2.135s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:27 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-0a5ec7c3-2975-47de-8460-f5edc564c95e tempest-VolumesSnapshotListTestJSON-1719169125 None] Created reservations ['a6789dcc-ab62-4bac-8405-b0fbfe8dc12a', '8947f101-5dd2-491c-b0e1-5b6bf82930d5', '7b1713fc-b637-4d74-a056-84b43b046c2f', '3a86792c-4213-4d05-aa13-c902f3b2024f'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0a5ec7c3-2975-47de-8460-f5edc564c95e tempest-VolumesSnapshotListTestJSON-1719169125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0a5ec7c3-2975-47de-8460-f5edc564c95e tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0a5ec7c3-2975-47de-8460-f5edc564c95e tempest-VolumesSnapshotListTestJSON-1719169125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0a5ec7c3-2975-47de-8460-f5edc564c95e tempest-VolumesSnapshotListTestJSON-1719169125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0a5ec7c3-2975-47de-8460-f5edc564c95e tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0a5ec7c3-2975-47de-8460-f5edc564c95e tempest-VolumesSnapshotListTestJSON-1719169125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:27 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:33:27 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:27 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0" returned: 0 in 1.078s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.04928ac4-2f7a-481e-a4c0-e673605ae00d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:27 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.04928ac4-2f7a-481e-a4c0-e673605ae00d Jul 07 17:33:27 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:28 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0a5ec7c3-2975-47de-8460-f5edc564c95e tempest-VolumesSnapshotListTestJSON-1719169125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.831s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:28 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-0a5ec7c3-2975-47de-8460-f5edc564c95e tempest-VolumesSnapshotListTestJSON-1719169125 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:28 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-0a5ec7c3-2975-47de-8460-f5edc564c95e tempest-VolumesSnapshotListTestJSON-1719169125 None] Deleted volume successfully. Jul 07 17:33:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0a5ec7c3-2975-47de-8460-f5edc564c95e tempest-VolumesSnapshotListTestJSON-1719169125 None] Lock "cinder-75307013-a21b-4368-b077-41fb37e9b33e-delete_volume" released by "delete_volume" :: held 3.297s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:28 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.04928ac4-2f7a-481e-a4c0-e673605ae00d" returned: 0 in 1.044s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.04928ac4-2f7a-481e-a4c0-e673605ae00d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:28 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.04928ac4-2f7a-481e-a4c0-e673605ae00d Jul 07 17:33:28 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:29 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0.04928ac4-2f7a-481e-a4c0-e673605ae00d" returned: 0 in 0.795s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Lock "cinder-quobyte-04928ac4-2f7a-481e-a4c0-e673605ae00d" released by "_delete_snapshot" :: held 4.092s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.612s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:29 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-4e77f350-cf45-4037-8a52-0fc580894da0 tempest-GroupsV314Test-1121392188 None] Create group from source-group-2af89b21-c9f1-46ce-9668-ce33501e6776 completed successfully. Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e908acb3-9874-4094-ad0f-d36ec6f22fcb tempest-GroupsV314Test-1121392188 None] Acquiring lock "cinder-quobyte-fd389f59-8c2f-4fb1-8e48-227a20c8b305" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e908acb3-9874-4094-ad0f-d36ec6f22fcb tempest-GroupsV314Test-1121392188 None] Lock "cinder-quobyte-fd389f59-8c2f-4fb1-8e48-227a20c8b305" acquired by "delete_volume" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[933cdffd-2320-488d-b81c-463475dacb5e]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e908acb3-9874-4094-ad0f-d36ec6f22fcb tempest-GroupsV314Test-1121392188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fd389f59-8c2f-4fb1-8e48-227a20c8b305 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:31 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fd389f59-8c2f-4fb1-8e48-227a20c8b305 Jul 07 17:33:31 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Flow 'volume_create_manager' (ef284b0e-88a0-42f4-9d4a-c28ca4b664db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb75a6c-ce23-4b42-b04c-bc2eec5fc68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb75a6c-ce23-4b42-b04c-bc2eec5fc68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1760989500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb74da1-717f-4706-b957-1c9bd123e138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b01e817be60412390c57e9293884041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:32Z,use_quota=True,user_id='87ad2f2c271845628120a191125eb9bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d91546-2779-478e-bd18-e3bd95619a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d91546-2779-478e-bd18-e3bd95619a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39ae274-829a-4e2f-942d-11ac919f7a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39ae274-829a-4e2f-942d-11ac919f7a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cb74da1-717f-4706-b957-1c9bd123e138', 'volume_name': 'volume-9cb74da1-717f-4706-b957-1c9bd123e138', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18287162-86dd-4357-a2ef-30ae460d51e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18287162-86dd-4357-a2ef-30ae460d51e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c90dbb8-d780-4ebb-86c4-b5e5c60decca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:31 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Volume 9cb74da1-717f-4706-b957-1c9bd123e138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cb74da1-717f-4706-b957-1c9bd123e138', 'volume_size': 1} Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1760989500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb74da1-717f-4706-b957-1c9bd123e138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b01e817be60412390c57e9293884041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:32Z,use_quota=True,user_id='87ad2f2c271845628120a191125eb9bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Creating volume 9cb74da1-717f-4706-b957-1c9bd123e138 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:31 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:33:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:31 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138 1073741824 Jul 07 17:33:31 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:32 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e908acb3-9874-4094-ad0f-d36ec6f22fcb tempest-GroupsV314Test-1121392188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fd389f59-8c2f-4fb1-8e48-227a20c8b305" returned: 0 in 0.984s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e908acb3-9874-4094-ad0f-d36ec6f22fcb tempest-GroupsV314Test-1121392188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fd389f59-8c2f-4fb1-8e48-227a20c8b305 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:32 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fd389f59-8c2f-4fb1-8e48-227a20c8b305 Jul 07 17:33:32 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:33 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138 1073741824" returned: 0 in 1.186s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:33 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138 Jul 07 17:33:33 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:33 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e908acb3-9874-4094-ad0f-d36ec6f22fcb tempest-GroupsV314Test-1121392188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fd389f59-8c2f-4fb1-8e48-227a20c8b305" returned: 0 in 0.956s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e908acb3-9874-4094-ad0f-d36ec6f22fcb tempest-GroupsV314Test-1121392188 None] Lock "cinder-quobyte-fd389f59-8c2f-4fb1-8e48-227a20c8b305" released by "delete_volume" :: held 2.025s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:33 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-e908acb3-9874-4094-ad0f-d36ec6f22fcb tempest-GroupsV314Test-1121392188 None] Created reservations ['0c2551fb-235e-43d1-8675-d8e88ca12c80'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:33 devstack cinder-volume[87303]: WARNING cinder.quota [None req-e908acb3-9874-4094-ad0f-d36ec6f22fcb tempest-GroupsV314Test-1121392188 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1732603616 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1732603616, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:33:33 devstack cinder-volume[87303]: WARNING cinder.quota [None req-e908acb3-9874-4094-ad0f-d36ec6f22fcb tempest-GroupsV314Test-1121392188 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1732603616 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1732603616, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:33:33 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-e908acb3-9874-4094-ad0f-d36ec6f22fcb tempest-GroupsV314Test-1121392188 None] Created reservations ['454dfbe1-0979-4386-bb8b-5b7460a6dd3b', 'e5058033-2974-425b-9093-513610ea730b', '332cdeb8-bac2-435e-838b-b4e0992611b4', '1a842a47-2bf8-4ccb-a22b-63f8857dbc98'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e908acb3-9874-4094-ad0f-d36ec6f22fcb tempest-GroupsV314Test-1121392188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e908acb3-9874-4094-ad0f-d36ec6f22fcb tempest-GroupsV314Test-1121392188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:33 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e908acb3-9874-4094-ad0f-d36ec6f22fcb tempest-GroupsV314Test-1121392188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:33 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e908acb3-9874-4094-ad0f-d36ec6f22fcb tempest-GroupsV314Test-1121392188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e908acb3-9874-4094-ad0f-d36ec6f22fcb tempest-GroupsV314Test-1121392188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e908acb3-9874-4094-ad0f-d36ec6f22fcb tempest-GroupsV314Test-1121392188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:33 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:33:33 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:34 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138" returned: 0 in 0.905s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] <== create_volume: return (2163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.165s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c90dbb8-d780-4ebb-86c4-b5e5c60decca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cb74da1-717f-4706-b957-1c9bd123e138', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d205be4-a967-42f1-b17c-b99a8f345ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:34 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Volume volume-9cb74da1-717f-4706-b957-1c9bd123e138 (9cb74da1-717f-4706-b957-1c9bd123e138): created successfully Jul 07 17:33:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d205be4-a967-42f1-b17c-b99a8f345ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Flow 'volume_create_manager' (ef284b0e-88a0-42f4-9d4a-c28ca4b664db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:34 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-dfb5caf2-1a16-4994-81d5-7ab576eec67c tempest-CreateVolumesFromSnapshotTest-1141117255 None] Created volume successfully. Jul 07 17:33:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4d502e6d-2d8e-4e7d-a44b-59832b73c1f1 tempest-GroupsV314Test-1121392188 None] Acquiring lock "cinder-quobyte-cb2f18a5-7951-4482-a798-34c9101f51c0" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4d502e6d-2d8e-4e7d-a44b-59832b73c1f1 tempest-GroupsV314Test-1121392188 None] Lock "cinder-quobyte-cb2f18a5-7951-4482-a798-34c9101f51c0" acquired by "delete_volume" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:34 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b0e399-626d-4b46-8640-c91d1c0ec319]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4d502e6d-2d8e-4e7d-a44b-59832b73c1f1 tempest-GroupsV314Test-1121392188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:34 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0 Jul 07 17:33:34 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:34 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e908acb3-9874-4094-ad0f-d36ec6f22fcb tempest-GroupsV314Test-1121392188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.869s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:34 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-e908acb3-9874-4094-ad0f-d36ec6f22fcb tempest-GroupsV314Test-1121392188 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:34 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-e908acb3-9874-4094-ad0f-d36ec6f22fcb tempest-GroupsV314Test-1121392188 None] Delete group completed successfully. Jul 07 17:33:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0494bec5-7bab-4bad-8f07-0c10ac08a909 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0494bec5-7bab-4bad-8f07-0c10ac08a909 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:35 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-0494bec5-7bab-4bad-8f07-0c10ac08a909 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Creating offline snapshot fb3ef0d7-618f-49a9-8c77-968a1c8d042d of volume 9cb74da1-717f-4706-b957-1c9bd123e138 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:33:35 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be52db3-9047-4710-9441-35ee1c81e873]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0494bec5-7bab-4bad-8f07-0c10ac08a909 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:35 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138 Jul 07 17:33:35 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:35 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4d502e6d-2d8e-4e7d-a44b-59832b73c1f1 tempest-GroupsV314Test-1121392188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0" returned: 0 in 1.159s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4d502e6d-2d8e-4e7d-a44b-59832b73c1f1 tempest-GroupsV314Test-1121392188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:35 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0 Jul 07 17:33:35 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:36 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0494bec5-7bab-4bad-8f07-0c10ac08a909 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138" returned: 0 in 1.031s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0494bec5-7bab-4bad-8f07-0c10ac08a909 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.fb3ef0d7-618f-49a9-8c77-968a1c8d042d 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:36 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.fb3ef0d7-618f-49a9-8c77-968a1c8d042d 1G Jul 07 17:33:36 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:36 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4d502e6d-2d8e-4e7d-a44b-59832b73c1f1 tempest-GroupsV314Test-1121392188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cb2f18a5-7951-4482-a798-34c9101f51c0" returned: 0 in 0.918s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4d502e6d-2d8e-4e7d-a44b-59832b73c1f1 tempest-GroupsV314Test-1121392188 None] Lock "cinder-quobyte-cb2f18a5-7951-4482-a798-34c9101f51c0" released by "delete_volume" :: held 2.175s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:36 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-4d502e6d-2d8e-4e7d-a44b-59832b73c1f1 tempest-GroupsV314Test-1121392188 None] Created reservations ['c2c78541-71fd-4a12-9ec5-b19f440d7ad9'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:36 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-4d502e6d-2d8e-4e7d-a44b-59832b73c1f1 tempest-GroupsV314Test-1121392188 None] Created reservations ['8223424c-95f2-4da8-a710-d9fb301bc076', 'f7e89a2d-db63-4a19-85af-ed3d017efea5', 'ecc8916e-6f39-4aa0-b6a2-d316eaaee236', '3477789a-633b-4d4a-b89d-8fc1d608d113'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4d502e6d-2d8e-4e7d-a44b-59832b73c1f1 tempest-GroupsV314Test-1121392188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4d502e6d-2d8e-4e7d-a44b-59832b73c1f1 tempest-GroupsV314Test-1121392188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4d502e6d-2d8e-4e7d-a44b-59832b73c1f1 tempest-GroupsV314Test-1121392188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4d502e6d-2d8e-4e7d-a44b-59832b73c1f1 tempest-GroupsV314Test-1121392188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4d502e6d-2d8e-4e7d-a44b-59832b73c1f1 tempest-GroupsV314Test-1121392188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4d502e6d-2d8e-4e7d-a44b-59832b73c1f1 tempest-GroupsV314Test-1121392188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:36 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:33:36 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:37 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0494bec5-7bab-4bad-8f07-0c10ac08a909 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.fb3ef0d7-618f-49a9-8c77-968a1c8d042d 1G" returned: 0 in 1.206s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0494bec5-7bab-4bad-8f07-0c10ac08a909 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cb74da1-717f-4706-b957-1c9bd123e138 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.fb3ef0d7-618f-49a9-8c77-968a1c8d042d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:37 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cb74da1-717f-4706-b957-1c9bd123e138 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.fb3ef0d7-618f-49a9-8c77-968a1c8d042d Jul 07 17:33:37 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:38 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4d502e6d-2d8e-4e7d-a44b-59832b73c1f1 tempest-GroupsV314Test-1121392188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.143s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:38 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-4d502e6d-2d8e-4e7d-a44b-59832b73c1f1 tempest-GroupsV314Test-1121392188 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:38 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-4d502e6d-2d8e-4e7d-a44b-59832b73c1f1 tempest-GroupsV314Test-1121392188 None] Delete group completed successfully. Jul 07 17:33:38 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0494bec5-7bab-4bad-8f07-0c10ac08a909 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cb74da1-717f-4706-b957-1c9bd123e138 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.fb3ef0d7-618f-49a9-8c77-968a1c8d042d" returned: 0 in 0.879s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:38 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-0494bec5-7bab-4bad-8f07-0c10ac08a909 tempest-CreateVolumesFromSnapshotTest-1141117255 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.fb3ef0d7-618f-49a9-8c77-968a1c8d042d is being set with open permissions: ugo+rw Jul 07 17:33:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0494bec5-7bab-4bad-8f07-0c10ac08a909 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.fb3ef0d7-618f-49a9-8c77-968a1c8d042d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:38 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.fb3ef0d7-618f-49a9-8c77-968a1c8d042d Jul 07 17:33:38 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:39 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0494bec5-7bab-4bad-8f07-0c10ac08a909 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.fb3ef0d7-618f-49a9-8c77-968a1c8d042d" returned: 0 in 0.987s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0494bec5-7bab-4bad-8f07-0c10ac08a909 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:39 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.info Jul 07 17:33:39 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:40 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0494bec5-7bab-4bad-8f07-0c10ac08a909 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.info" returned: 0 in 0.856s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:40 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-0494bec5-7bab-4bad-8f07-0c10ac08a909 tempest-CreateVolumesFromSnapshotTest-1141117255 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.info is being set with open permissions: ugo+rw Jul 07 17:33:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0494bec5-7bab-4bad-8f07-0c10ac08a909 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:40 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.info Jul 07 17:33:40 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:41 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0494bec5-7bab-4bad-8f07-0c10ac08a909 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.info" returned: 0 in 0.815s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0494bec5-7bab-4bad-8f07-0c10ac08a909 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.910s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:41 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-0494bec5-7bab-4bad-8f07-0c10ac08a909 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Create snapshot completed successfully Jul 07 17:33:42 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Flow 'volume_create_manager' (3c465982-ef31-40e3-a24b-4f3b4b4e12c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec2655e-fce9-4804-9ad5-b2142ff37832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:42 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=99,cinder:UPDATE=105,cinder:DELETE=3,cinder:INSERT=26 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:33:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec2655e-fce9-4804-9ad5-b2142ff37832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-781676366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72904dc4-1c9c-423c-beb3-3679f788a14f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b01e817be60412390c57e9293884041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:42Z,use_quota=True,user_id='87ad2f2c271845628120a191125eb9bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448de276-70df-480f-900d-037440d0ef27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448de276-70df-480f-900d-037440d0ef27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e24feba-1f43-401a-8b31-c2e01283f9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e24feba-1f43-401a-8b31-c2e01283f9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72904dc4-1c9c-423c-beb3-3679f788a14f', 'volume_name': 'volume-72904dc4-1c9c-423c-beb3-3679f788a14f', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f01c24d-7dec-4bd9-a6d1-daa0b57cdb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f01c24d-7dec-4bd9-a6d1-daa0b57cdb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80025690-50ad-4492-9c4d-91fa35cd1caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:42 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Volume 72904dc4-1c9c-423c-beb3-3679f788a14f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72904dc4-1c9c-423c-beb3-3679f788a14f', 'volume_size': 1} Jul 07 17:33:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-781676366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72904dc4-1c9c-423c-beb3-3679f788a14f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b01e817be60412390c57e9293884041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:42Z,use_quota=True,user_id='87ad2f2c271845628120a191125eb9bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Creating volume 72904dc4-1c9c-423c-beb3-3679f788a14f {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:42 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:33:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-72904dc4-1c9c-423c-beb3-3679f788a14f 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:42 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-72904dc4-1c9c-423c-beb3-3679f788a14f 1073741824 Jul 07 17:33:42 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Flow 'volume_create_manager' (5f965b39-562a-44df-8b08-617a8d23f6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64f2ea3-dde7-435b-a472-f86f11cae09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64f2ea3-dde7-435b-a472-f86f11cae09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1336263198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd0665b-aea1-42b5-8dab-b028d303bf22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b01e817be60412390c57e9293884041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:43Z,use_quota=True,user_id='87ad2f2c271845628120a191125eb9bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0949c8c8-e54d-4e19-9f78-fce5e093ad3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0949c8c8-e54d-4e19-9f78-fce5e093ad3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b61ef3-1aa6-4e12-92e9-f2052e088f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b61ef3-1aa6-4e12-92e9-f2052e088f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cd0665b-aea1-42b5-8dab-b028d303bf22', 'volume_name': 'volume-7cd0665b-aea1-42b5-8dab-b028d303bf22', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fa8067-81e7-43d9-bde1-928ff1949d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fa8067-81e7-43d9-bde1-928ff1949d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6040a9e3-04ba-441f-b66f-bb0443ec2b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:43 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Volume 7cd0665b-aea1-42b5-8dab-b028d303bf22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cd0665b-aea1-42b5-8dab-b028d303bf22', 'volume_size': 1} Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Flow 'volume_create_manager' (ee40f6f8-f8b5-4d23-bd58-b43c97382dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963e7547-9c38-4843-8fa4-557021a07438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963e7547-9c38-4843-8fa4-557021a07438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1766536916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fccfb935-90f6-49d2-98ad-4357bb56d8e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b01e817be60412390c57e9293884041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:44Z,use_quota=True,user_id='87ad2f2c271845628120a191125eb9bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d2dbd6-e98e-43ba-a304-b230eb0003e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d2dbd6-e98e-43ba-a304-b230eb0003e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfbb527e-4341-423e-8431-dfb8f1a3df19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfbb527e-4341-423e-8431-dfb8f1a3df19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fccfb935-90f6-49d2-98ad-4357bb56d8e3', 'volume_name': 'volume-fccfb935-90f6-49d2-98ad-4357bb56d8e3', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b22006a-0728-4d54-a3bb-250e6ce83711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b22006a-0728-4d54-a3bb-250e6ce83711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e479ab-0c17-4868-9958-638165f06888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:43 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Volume fccfb935-90f6-49d2-98ad-4357bb56d8e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fccfb935-90f6-49d2-98ad-4357bb56d8e3', 'volume_size': 1} Jul 07 17:33:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:44 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-72904dc4-1c9c-423c-beb3-3679f788a14f 1073741824" returned: 0 in 1.324s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-72904dc4-1c9c-423c-beb3-3679f788a14f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:44 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-72904dc4-1c9c-423c-beb3-3679f788a14f Jul 07 17:33:44 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:44 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Flow 'volume_create_manager' (b0e83a9b-0c35-4c2d-9425-8c3e31200844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2370bfc-a812-4019-9f14-6ff1c634bf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2370bfc-a812-4019-9f14-6ff1c634bf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2078807746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b3a3ac6-432f-4daf-af11-1317450fd10c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b01e817be60412390c57e9293884041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:44Z,use_quota=True,user_id='87ad2f2c271845628120a191125eb9bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88880e01-3748-4e9a-ae5f-6bb31e3a6c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88880e01-3748-4e9a-ae5f-6bb31e3a6c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f264c34-79fe-4fd5-8e30-a9dc1916ca5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f264c34-79fe-4fd5-8e30-a9dc1916ca5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b3a3ac6-432f-4daf-af11-1317450fd10c', 'volume_name': 'volume-2b3a3ac6-432f-4daf-af11-1317450fd10c', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ac1d1f3-31e7-4519-9a01-152b2855ef83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ac1d1f3-31e7-4519-9a01-152b2855ef83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9805b60-4bd7-44d1-8519-997bdfbd729c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:44 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Volume 2b3a3ac6-432f-4daf-af11-1317450fd10c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b3a3ac6-432f-4daf-af11-1317450fd10c', 'volume_size': 1} Jul 07 17:33:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:45 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5ba4a38c-8eed-471d-9ecf-1aef5a763473 tempest-GroupsV320Test-912220355 None] Group tempest-GroupsV320Test-Group-1993360553: creating Jul 07 17:33:45 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5ba4a38c-8eed-471d-9ecf-1aef5a763473 tempest-GroupsV320Test-912220355 None] Group tempest-GroupsV320Test-Group-1993360553: created successfully Jul 07 17:33:45 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5ba4a38c-8eed-471d-9ecf-1aef5a763473 tempest-GroupsV320Test-912220355 None] Create group completed successfully. Jul 07 17:33:45 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-72904dc4-1c9c-423c-beb3-3679f788a14f" returned: 0 in 1.054s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] <== create_volume: return (2449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.452s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.975s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1336263198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd0665b-aea1-42b5-8dab-b028d303bf22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b01e817be60412390c57e9293884041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:43Z,use_quota=True,user_id='87ad2f2c271845628120a191125eb9bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Creating volume 7cd0665b-aea1-42b5-8dab-b028d303bf22 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:45 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cd0665b-aea1-42b5-8dab-b028d303bf22 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80025690-50ad-4492-9c4d-91fa35cd1caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72904dc4-1c9c-423c-beb3-3679f788a14f', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:45 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cd0665b-aea1-42b5-8dab-b028d303bf22 1073741824 Jul 07 17:33:45 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a739fd-68ae-4ff9-a6cc-32786e82316f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:45 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Volume volume-72904dc4-1c9c-423c-beb3-3679f788a14f (72904dc4-1c9c-423c-beb3-3679f788a14f): created successfully Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a739fd-68ae-4ff9-a6cc-32786e82316f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Flow 'volume_create_manager' (3c465982-ef31-40e3-a24b-4f3b4b4e12c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Flow 'volume_create_manager' (a3499d9b-e677-4346-aa42-69ed79b4a575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (246421b4-975a-4d86-9470-f537cd9b127c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:45 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-17b84074-9cd1-4058-94b8-69ed993a6ec9 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Created volume successfully. Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (246421b4-975a-4d86-9470-f537cd9b127c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-681530608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8edbee3-f695-44fb-b3a3-305c48dfceef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b01e817be60412390c57e9293884041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:45Z,use_quota=True,user_id='87ad2f2c271845628120a191125eb9bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74252e6b-6ef5-4ab1-a8d4-3b0c7f65f1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74252e6b-6ef5-4ab1-a8d4-3b0c7f65f1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31e1ef5c-f33c-40a4-837b-833e884edc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31e1ef5c-f33c-40a4-837b-833e884edc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8edbee3-f695-44fb-b3a3-305c48dfceef', 'volume_name': 'volume-e8edbee3-f695-44fb-b3a3-305c48dfceef', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab4d789-3725-4a13-8de3-85e5039a56c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab4d789-3725-4a13-8de3-85e5039a56c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (512679b6-5b36-4571-8a17-087145d4e7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:45 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Volume e8edbee3-f695-44fb-b3a3-305c48dfceef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8edbee3-f695-44fb-b3a3-305c48dfceef', 'volume_size': 1} Jul 07 17:33:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:46 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cd0665b-aea1-42b5-8dab-b028d303bf22 1073741824" returned: 0 in 1.272s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cd0665b-aea1-42b5-8dab-b028d303bf22 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:46 devstack sudo[101370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cd0665b-aea1-42b5-8dab-b028d303bf22 Jul 07 17:33:46 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:46 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-35fb3a1b-be38-4dec-8210-63de10d78a73 tempest-GroupsV320Test-912220355 None] Created reservations ['65b1c0c7-955c-4efd-9fc6-54a1858d8be5'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-35fb3a1b-be38-4dec-8210-63de10d78a73 tempest-GroupsV320Test-912220355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-35fb3a1b-be38-4dec-8210-63de10d78a73 tempest-GroupsV320Test-912220355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-35fb3a1b-be38-4dec-8210-63de10d78a73 tempest-GroupsV320Test-912220355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-35fb3a1b-be38-4dec-8210-63de10d78a73 tempest-GroupsV320Test-912220355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-35fb3a1b-be38-4dec-8210-63de10d78a73 tempest-GroupsV320Test-912220355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-35fb3a1b-be38-4dec-8210-63de10d78a73 tempest-GroupsV320Test-912220355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:46 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:33:46 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:47 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cd0665b-aea1-42b5-8dab-b028d303bf22" returned: 0 in 0.833s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] <== create_volume: return (2165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.168s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.519s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1766536916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fccfb935-90f6-49d2-98ad-4357bb56d8e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b01e817be60412390c57e9293884041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:44Z,use_quota=True,user_id='87ad2f2c271845628120a191125eb9bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Creating volume fccfb935-90f6-49d2-98ad-4357bb56d8e3 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:47 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:33:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fccfb935-90f6-49d2-98ad-4357bb56d8e3 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6040a9e3-04ba-441f-b66f-bb0443ec2b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd0665b-aea1-42b5-8dab-b028d303bf22', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:47 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fccfb935-90f6-49d2-98ad-4357bb56d8e3 1073741824 Jul 07 17:33:47 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ac5172-128f-43eb-9d77-06e64a86407d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:47 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Volume volume-7cd0665b-aea1-42b5-8dab-b028d303bf22 (7cd0665b-aea1-42b5-8dab-b028d303bf22): created successfully Jul 07 17:33:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ac5172-128f-43eb-9d77-06e64a86407d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Flow 'volume_create_manager' (5f965b39-562a-44df-8b08-617a8d23f6e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:47 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-4dc2b9d8-f8a9-4771-9535-0df036daf159 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Created volume successfully. Jul 07 17:33:47 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-35fb3a1b-be38-4dec-8210-63de10d78a73 tempest-GroupsV320Test-912220355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.842s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:47 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-35fb3a1b-be38-4dec-8210-63de10d78a73 tempest-GroupsV320Test-912220355 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:47 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-35fb3a1b-be38-4dec-8210-63de10d78a73 tempest-GroupsV320Test-912220355 None] Delete group completed successfully. Jul 07 17:33:48 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fccfb935-90f6-49d2-98ad-4357bb56d8e3 1073741824" returned: 0 in 1.226s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fccfb935-90f6-49d2-98ad-4357bb56d8e3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:48 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fccfb935-90f6-49d2-98ad-4357bb56d8e3 Jul 07 17:33:48 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:49 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fccfb935-90f6-49d2-98ad-4357bb56d8e3" returned: 0 in 1.138s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] <== create_volume: return (2425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.429s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.363s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2078807746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b3a3ac6-432f-4daf-af11-1317450fd10c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b01e817be60412390c57e9293884041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:44Z,use_quota=True,user_id='87ad2f2c271845628120a191125eb9bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Creating volume 2b3a3ac6-432f-4daf-af11-1317450fd10c {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:49 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:33:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b3a3ac6-432f-4daf-af11-1317450fd10c 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e479ab-0c17-4868-9958-638165f06888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fccfb935-90f6-49d2-98ad-4357bb56d8e3', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:49 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b3a3ac6-432f-4daf-af11-1317450fd10c 1073741824 Jul 07 17:33:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bfc00a9-eb03-4709-8e77-72796fa9a822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:49 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:49 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Volume volume-fccfb935-90f6-49d2-98ad-4357bb56d8e3 (fccfb935-90f6-49d2-98ad-4357bb56d8e3): created successfully Jul 07 17:33:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bfc00a9-eb03-4709-8e77-72796fa9a822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Flow 'volume_create_manager' (ee40f6f8-f8b5-4d23-bd58-b43c97382dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:49 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-e50e3074-738c-4193-bb2d-e25a6f83b8fe tempest-CreateVolumesFromSnapshotTest-1141117255 None] Created volume successfully. Jul 07 17:33:50 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b3a3ac6-432f-4daf-af11-1317450fd10c 1073741824" returned: 0 in 1.199s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b3a3ac6-432f-4daf-af11-1317450fd10c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:51 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b3a3ac6-432f-4daf-af11-1317450fd10c Jul 07 17:33:51 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:51 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b3a3ac6-432f-4daf-af11-1317450fd10c" returned: 0 in 0.856s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.111s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.469s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-681530608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8edbee3-f695-44fb-b3a3-305c48dfceef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b01e817be60412390c57e9293884041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:33:45Z,use_quota=True,user_id='87ad2f2c271845628120a191125eb9bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:33:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Creating volume e8edbee3-f695-44fb-b3a3-305c48dfceef {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:33:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:33:51 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:33:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8edbee3-f695-44fb-b3a3-305c48dfceef 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:51 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8edbee3-f695-44fb-b3a3-305c48dfceef 1073741824 Jul 07 17:33:51 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:51 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9805b60-4bd7-44d1-8519-997bdfbd729c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b3a3ac6-432f-4daf-af11-1317450fd10c', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:51 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68db0cd6-dab4-49e7-be59-864ed27f58d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:52 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Volume volume-2b3a3ac6-432f-4daf-af11-1317450fd10c (2b3a3ac6-432f-4daf-af11-1317450fd10c): created successfully Jul 07 17:33:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68db0cd6-dab4-49e7-be59-864ed27f58d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Flow 'volume_create_manager' (b0e83a9b-0c35-4c2d-9425-8c3e31200844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:52 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5d6b7f2b-efa0-4ea4-9882-1ad07135bbf4 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Created volume successfully. Jul 07 17:33:53 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8edbee3-f695-44fb-b3a3-305c48dfceef 1073741824" returned: 0 in 1.290s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8edbee3-f695-44fb-b3a3-305c48dfceef {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:53 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8edbee3-f695-44fb-b3a3-305c48dfceef Jul 07 17:33:53 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:54 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8edbee3-f695-44fb-b3a3-305c48dfceef" returned: 0 in 0.824s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:54 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] <== create_volume: return (2170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:33:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.177s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (512679b6-5b36-4571-8a17-087145d4e7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8edbee3-f695-44fb-b3a3-305c48dfceef', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9f29f1-7af0-4662-a6c4-80d507a68992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:33:54 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Volume volume-e8edbee3-f695-44fb-b3a3-305c48dfceef (e8edbee3-f695-44fb-b3a3-305c48dfceef): created successfully Jul 07 17:33:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9f29f1-7af0-4662-a6c4-80d507a68992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:33:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Flow 'volume_create_manager' (a3499d9b-e677-4346-aa42-69ed79b4a575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:33:54 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-06be3bf5-7e66-40cd-b7ea-c9b20ca5eff5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Created volume successfully. Jul 07 17:33:55 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-34c32392-7fac-4f72-b436-2c45f3161636 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "cinder-e8edbee3-f695-44fb-b3a3-305c48dfceef-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:55 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-34c32392-7fac-4f72-b436-2c45f3161636 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-e8edbee3-f695-44fb-b3a3-305c48dfceef-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:55 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-34c32392-7fac-4f72-b436-2c45f3161636 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "cinder-quobyte-e8edbee3-f695-44fb-b3a3-305c48dfceef" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:55 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-34c32392-7fac-4f72-b436-2c45f3161636 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-quobyte-e8edbee3-f695-44fb-b3a3-305c48dfceef" acquired by "delete_volume" :: waited 0.018s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:55 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd73d575-f551-4f4d-baf3-d0e45a7c77b0]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-34c32392-7fac-4f72-b436-2c45f3161636 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8edbee3-f695-44fb-b3a3-305c48dfceef {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:55 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8edbee3-f695-44fb-b3a3-305c48dfceef Jul 07 17:33:55 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:56 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-34c32392-7fac-4f72-b436-2c45f3161636 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8edbee3-f695-44fb-b3a3-305c48dfceef" returned: 0 in 1.099s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-34c32392-7fac-4f72-b436-2c45f3161636 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8edbee3-f695-44fb-b3a3-305c48dfceef {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:56 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8edbee3-f695-44fb-b3a3-305c48dfceef Jul 07 17:33:56 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:33:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:56 devstack sudo[101452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:33:56 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:57 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-34c32392-7fac-4f72-b436-2c45f3161636 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e8edbee3-f695-44fb-b3a3-305c48dfceef" returned: 0 in 0.814s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-34c32392-7fac-4f72-b436-2c45f3161636 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-quobyte-e8edbee3-f695-44fb-b3a3-305c48dfceef" released by "delete_volume" :: held 1.987s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:57 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-34c32392-7fac-4f72-b436-2c45f3161636 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Created reservations ['0fbc7b62-f0cd-45f5-b8a4-15f62e5d390e', '1cf878dc-e9f3-41b2-9583-cdaf63c6fb23', '11019178-7820-453b-a465-ac0635a0a555', '0bcf7c58-9588-4502-bcf8-efc21b620c48'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:33:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-34c32392-7fac-4f72-b436-2c45f3161636 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:33:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-34c32392-7fac-4f72-b436-2c45f3161636 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:33:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-34c32392-7fac-4f72-b436-2c45f3161636 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:33:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-34c32392-7fac-4f72-b436-2c45f3161636 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:33:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-34c32392-7fac-4f72-b436-2c45f3161636 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:33:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-34c32392-7fac-4f72-b436-2c45f3161636 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:57 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.931s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:57 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:33:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:33:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:33:57 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:33:57 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:58 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-34c32392-7fac-4f72-b436-2c45f3161636 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.866s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:58 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-34c32392-7fac-4f72-b436-2c45f3161636 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:33:58 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-34c32392-7fac-4f72-b436-2c45f3161636 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Deleted volume successfully. Jul 07 17:33:58 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-34c32392-7fac-4f72-b436-2c45f3161636 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-e8edbee3-f695-44fb-b3a3-305c48dfceef-delete_volume" released by "delete_volume" :: held 3.281s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:33:58 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4d4293f7-1d0c-495e-8cd6-bafed1014a95 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "cinder-2b3a3ac6-432f-4daf-af11-1317450fd10c-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:58 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4d4293f7-1d0c-495e-8cd6-bafed1014a95 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-2b3a3ac6-432f-4daf-af11-1317450fd10c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:58 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4d4293f7-1d0c-495e-8cd6-bafed1014a95 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "cinder-quobyte-2b3a3ac6-432f-4daf-af11-1317450fd10c" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:33:58 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4d4293f7-1d0c-495e-8cd6-bafed1014a95 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-quobyte-2b3a3ac6-432f-4daf-af11-1317450fd10c" acquired by "delete_volume" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:33:58 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee31bde-4da0-4cd0-af87-b8eac400bfec]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:33:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4d4293f7-1d0c-495e-8cd6-bafed1014a95 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b3a3ac6-432f-4daf-af11-1317450fd10c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:59 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b3a3ac6-432f-4daf-af11-1317450fd10c Jul 07 17:33:59 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:33:59 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Jul 07 17:33:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4d4293f7-1d0c-495e-8cd6-bafed1014a95 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b3a3ac6-432f-4daf-af11-1317450fd10c" returned: 0 in 1.074s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:33:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4d4293f7-1d0c-495e-8cd6-bafed1014a95 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b3a3ac6-432f-4daf-af11-1317450fd10c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:33:59 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b3a3ac6-432f-4daf-af11-1317450fd10c Jul 07 17:33:59 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:00 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4d4293f7-1d0c-495e-8cd6-bafed1014a95 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-2b3a3ac6-432f-4daf-af11-1317450fd10c" returned: 0 in 1.016s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:00 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4d4293f7-1d0c-495e-8cd6-bafed1014a95 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-quobyte-2b3a3ac6-432f-4daf-af11-1317450fd10c" released by "delete_volume" :: held 2.157s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:01 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-4d4293f7-1d0c-495e-8cd6-bafed1014a95 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Created reservations ['5ad96aac-1e56-4213-b44a-755bb457d17e', '4554e1f8-f9c0-4d64-bb45-6caf391b1b40', '17602019-0dc2-48bf-a610-ac613177ac60', 'f06e3eb5-0a90-4800-8290-fb22df689dbb'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4d4293f7-1d0c-495e-8cd6-bafed1014a95 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4d4293f7-1d0c-495e-8cd6-bafed1014a95 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4d4293f7-1d0c-495e-8cd6-bafed1014a95 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4d4293f7-1d0c-495e-8cd6-bafed1014a95 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4d4293f7-1d0c-495e-8cd6-bafed1014a95 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4d4293f7-1d0c-495e-8cd6-bafed1014a95 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:01 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:34:01 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-efcf88bf-c85c-47e0-ae39-03ccfd8635d1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "cinder-fccfb935-90f6-49d2-98ad-4357bb56d8e3-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:02 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-efcf88bf-c85c-47e0-ae39-03ccfd8635d1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-fccfb935-90f6-49d2-98ad-4357bb56d8e3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4d4293f7-1d0c-495e-8cd6-bafed1014a95 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.983s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:02 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-4d4293f7-1d0c-495e-8cd6-bafed1014a95 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:02 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-4d4293f7-1d0c-495e-8cd6-bafed1014a95 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Deleted volume successfully. Jul 07 17:34:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4d4293f7-1d0c-495e-8cd6-bafed1014a95 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-2b3a3ac6-432f-4daf-af11-1317450fd10c-delete_volume" released by "delete_volume" :: held 3.552s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-efcf88bf-c85c-47e0-ae39-03ccfd8635d1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "cinder-quobyte-fccfb935-90f6-49d2-98ad-4357bb56d8e3" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-efcf88bf-c85c-47e0-ae39-03ccfd8635d1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-quobyte-fccfb935-90f6-49d2-98ad-4357bb56d8e3" acquired by "delete_volume" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:02 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ca23a8-0f6b-4d79-a40e-b11939ca1506]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-efcf88bf-c85c-47e0-ae39-03ccfd8635d1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fccfb935-90f6-49d2-98ad-4357bb56d8e3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:02 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fccfb935-90f6-49d2-98ad-4357bb56d8e3 Jul 07 17:34:02 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:03 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-efcf88bf-c85c-47e0-ae39-03ccfd8635d1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fccfb935-90f6-49d2-98ad-4357bb56d8e3" returned: 0 in 1.174s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-efcf88bf-c85c-47e0-ae39-03ccfd8635d1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fccfb935-90f6-49d2-98ad-4357bb56d8e3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:03 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fccfb935-90f6-49d2-98ad-4357bb56d8e3 Jul 07 17:34:03 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Flow 'volume_create_manager' (f04aabb5-a0bf-4335-bba2-05825b492c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d8ece26-650b-4072-ae05-9960e75e2336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d8ece26-650b-4072-ae05-9960e75e2336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-293444161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=702dc879-8fe8-4367-bfd4-35dea61b9ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ff8a8629864009b431ef467f982600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:04Z,use_quota=True,user_id='79d58c17ece7446ca4176a2e128f3ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918b9545-6f6b-4c8d-acc9-6926eadfbfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918b9545-6f6b-4c8d-acc9-6926eadfbfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd103a99-313f-4758-8d7c-fa69853338a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd103a99-313f-4758-8d7c-fa69853338a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '702dc879-8fe8-4367-bfd4-35dea61b9ba6', 'volume_name': 'volume-702dc879-8fe8-4367-bfd4-35dea61b9ba6', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18271efa-29cd-42c9-bc6d-a53604727bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18271efa-29cd-42c9-bc6d-a53604727bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7bdc8a-5315-461b-a9be-d63c41bfbd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:03 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Volume 702dc879-8fe8-4367-bfd4-35dea61b9ba6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-702dc879-8fe8-4367-bfd4-35dea61b9ba6', 'volume_size': 1} Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-293444161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=702dc879-8fe8-4367-bfd4-35dea61b9ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ff8a8629864009b431ef467f982600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:04Z,use_quota=True,user_id='79d58c17ece7446ca4176a2e128f3ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Creating volume 702dc879-8fe8-4367-bfd4-35dea61b9ba6 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:03 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:34:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-702dc879-8fe8-4367-bfd4-35dea61b9ba6 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:03 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-702dc879-8fe8-4367-bfd4-35dea61b9ba6 1073741824 Jul 07 17:34:03 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:04 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-efcf88bf-c85c-47e0-ae39-03ccfd8635d1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fccfb935-90f6-49d2-98ad-4357bb56d8e3" returned: 0 in 0.815s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:04 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-efcf88bf-c85c-47e0-ae39-03ccfd8635d1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-quobyte-fccfb935-90f6-49d2-98ad-4357bb56d8e3" released by "delete_volume" :: held 2.050s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:04 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-efcf88bf-c85c-47e0-ae39-03ccfd8635d1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Created reservations ['24e0d689-5603-4d60-ac76-e9179bf38501', '21fee3ff-f35b-4c55-b153-e7043ec7ef94', '8164c75b-3d56-4c5b-9dc0-c10f1ca0e493', '76936455-ae88-49a2-88c7-67afdef23265'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-efcf88bf-c85c-47e0-ae39-03ccfd8635d1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-efcf88bf-c85c-47e0-ae39-03ccfd8635d1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-efcf88bf-c85c-47e0-ae39-03ccfd8635d1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-efcf88bf-c85c-47e0-ae39-03ccfd8635d1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-efcf88bf-c85c-47e0-ae39-03ccfd8635d1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-efcf88bf-c85c-47e0-ae39-03ccfd8635d1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:04 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:34:04 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:04 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-27ce5f4a-cc56-4ce9-bb40-5c29cd025bd1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "cinder-7cd0665b-aea1-42b5-8dab-b028d303bf22-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:04 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-27ce5f4a-cc56-4ce9-bb40-5c29cd025bd1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-7cd0665b-aea1-42b5-8dab-b028d303bf22-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:04 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-27ce5f4a-cc56-4ce9-bb40-5c29cd025bd1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "cinder-quobyte-7cd0665b-aea1-42b5-8dab-b028d303bf22" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:04 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-27ce5f4a-cc56-4ce9-bb40-5c29cd025bd1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-quobyte-7cd0665b-aea1-42b5-8dab-b028d303bf22" acquired by "delete_volume" :: waited 0.040s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:04 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0edda8-2dd7-4f2c-bb8b-ef7cb8cebdac]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-27ce5f4a-cc56-4ce9-bb40-5c29cd025bd1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cd0665b-aea1-42b5-8dab-b028d303bf22 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:04 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cd0665b-aea1-42b5-8dab-b028d303bf22 Jul 07 17:34:04 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:05 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-702dc879-8fe8-4367-bfd4-35dea61b9ba6 1073741824" returned: 0 in 1.198s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-702dc879-8fe8-4367-bfd4-35dea61b9ba6 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:05 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-702dc879-8fe8-4367-bfd4-35dea61b9ba6 Jul 07 17:34:05 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:05 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-efcf88bf-c85c-47e0-ae39-03ccfd8635d1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.272s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:05 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-efcf88bf-c85c-47e0-ae39-03ccfd8635d1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:05 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-efcf88bf-c85c-47e0-ae39-03ccfd8635d1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Deleted volume successfully. Jul 07 17:34:05 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-efcf88bf-c85c-47e0-ae39-03ccfd8635d1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-fccfb935-90f6-49d2-98ad-4357bb56d8e3-delete_volume" released by "delete_volume" :: held 3.711s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:06 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-27ce5f4a-cc56-4ce9-bb40-5c29cd025bd1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cd0665b-aea1-42b5-8dab-b028d303bf22" returned: 0 in 1.308s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-27ce5f4a-cc56-4ce9-bb40-5c29cd025bd1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cd0665b-aea1-42b5-8dab-b028d303bf22 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:06 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cd0665b-aea1-42b5-8dab-b028d303bf22 Jul 07 17:34:06 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:06 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-702dc879-8fe8-4367-bfd4-35dea61b9ba6" returned: 0 in 0.883s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] <== create_volume: return (2298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.301s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7bdc8a-5315-461b-a9be-d63c41bfbd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-702dc879-8fe8-4367-bfd4-35dea61b9ba6', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d47eb399-f9d5-4607-9af4-3c815ca8d290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:06 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Volume volume-702dc879-8fe8-4367-bfd4-35dea61b9ba6 (702dc879-8fe8-4367-bfd4-35dea61b9ba6): created successfully Jul 07 17:34:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d47eb399-f9d5-4607-9af4-3c815ca8d290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Flow 'volume_create_manager' (f04aabb5-a0bf-4335-bba2-05825b492c09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:06 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-54b8bb14-e7af-40f9-9376-0001844676e0 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Created volume successfully. Jul 07 17:34:06 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-27ce5f4a-cc56-4ce9-bb40-5c29cd025bd1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7cd0665b-aea1-42b5-8dab-b028d303bf22" returned: 0 in 0.837s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-27ce5f4a-cc56-4ce9-bb40-5c29cd025bd1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-quobyte-7cd0665b-aea1-42b5-8dab-b028d303bf22" released by "delete_volume" :: held 2.205s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:06 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:UPDATE=112,cinder:DELETE=8,cinder:SELECT=88,cinder:INSERT=32 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:34:07 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-27ce5f4a-cc56-4ce9-bb40-5c29cd025bd1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Created reservations ['c1ce596c-f3cb-425e-86d0-f1ea312966f3', 'fc750454-8c6f-4acd-949b-58a24a3b5a9a', '28139496-04eb-4c8a-bb14-201a3a51d19b', '9f57a55c-ad43-4c56-8c8e-f08fbe42549f'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-27ce5f4a-cc56-4ce9-bb40-5c29cd025bd1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-27ce5f4a-cc56-4ce9-bb40-5c29cd025bd1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-27ce5f4a-cc56-4ce9-bb40-5c29cd025bd1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-27ce5f4a-cc56-4ce9-bb40-5c29cd025bd1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-27ce5f4a-cc56-4ce9-bb40-5c29cd025bd1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-27ce5f4a-cc56-4ce9-bb40-5c29cd025bd1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:07 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:34:07 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:08 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-27ce5f4a-cc56-4ce9-bb40-5c29cd025bd1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.928s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-27ce5f4a-cc56-4ce9-bb40-5c29cd025bd1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:08 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-27ce5f4a-cc56-4ce9-bb40-5c29cd025bd1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Deleted volume successfully. Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-27ce5f4a-cc56-4ce9-bb40-5c29cd025bd1 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-7cd0665b-aea1-42b5-8dab-b028d303bf22-delete_volume" released by "delete_volume" :: held 3.489s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a876eec3-f5f4-492b-8044-efe479cf21a2 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "cinder-72904dc4-1c9c-423c-beb3-3679f788a14f-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ddec8801-48c3-4c60-b4a8-105315ad4876 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Acquiring lock "cinder-702dc879-8fe8-4367-bfd4-35dea61b9ba6-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a876eec3-f5f4-492b-8044-efe479cf21a2 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-72904dc4-1c9c-423c-beb3-3679f788a14f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ddec8801-48c3-4c60-b4a8-105315ad4876 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Lock "cinder-702dc879-8fe8-4367-bfd4-35dea61b9ba6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a876eec3-f5f4-492b-8044-efe479cf21a2 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "cinder-quobyte-72904dc4-1c9c-423c-beb3-3679f788a14f" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a876eec3-f5f4-492b-8044-efe479cf21a2 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-quobyte-72904dc4-1c9c-423c-beb3-3679f788a14f" acquired by "delete_volume" :: waited 0.054s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ddec8801-48c3-4c60-b4a8-105315ad4876 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Acquiring lock "cinder-quobyte-702dc879-8fe8-4367-bfd4-35dea61b9ba6" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a7131f-e769-442b-92d0-7f27d57fb3fa]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a876eec3-f5f4-492b-8044-efe479cf21a2 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-72904dc4-1c9c-423c-beb3-3679f788a14f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ddec8801-48c3-4c60-b4a8-105315ad4876 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Lock "cinder-quobyte-702dc879-8fe8-4367-bfd4-35dea61b9ba6" acquired by "delete_volume" :: waited 0.045s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Flow 'volume_create_manager' (7459fcbc-07b1-493d-9164-715ce35ab7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fecb851-bb23-4216-ae0d-4634fc308e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[42266d21-f350-4385-8436-3957450b6f79]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ddec8801-48c3-4c60-b4a8-105315ad4876 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-702dc879-8fe8-4367-bfd4-35dea61b9ba6 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fecb851-bb23-4216-ae0d-4634fc308e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1106378658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a46868e2a3c4e52922cf252261c916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:08Z,use_quota=True,user_id='6136bd97ba0a45cfb745e3c2021fddf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54fcb37c-f709-49a6-81b9-593ba02d9582),volume_type_id=54fcb37c-f709-49a6-81b9-593ba02d9582)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df855794-edf9-490e-9a39-6e7ba04e5269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:08 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-72904dc4-1c9c-423c-beb3-3679f788a14f Jul 07 17:34:08 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df855794-edf9-490e-9a39-6e7ba04e5269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0d364c-4734-452a-a540-1341a6fe5437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0d364c-4734-452a-a540-1341a6fe5437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0', 'volume_name': 'volume-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef5aeb3-1f5c-4dd5-b50e-1e869a5e6ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef5aeb3-1f5c-4dd5-b50e-1e869a5e6ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d752bbc-6ef2-423e-83f4-dd4bd2ab2a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:08 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Volume efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0', 'volume_size': 1} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1106378658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a46868e2a3c4e52922cf252261c916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:08Z,use_quota=True,user_id='6136bd97ba0a45cfb745e3c2021fddf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54fcb37c-f709-49a6-81b9-593ba02d9582),volume_type_id=54fcb37c-f709-49a6-81b9-593ba02d9582)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Creating volume efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:08 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:34:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:08 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0 1073741824 Jul 07 17:34:08 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:08 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-702dc879-8fe8-4367-bfd4-35dea61b9ba6 Jul 07 17:34:08 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:09 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Flow 'volume_create_manager' (648a0a49-50d5-4abb-b367-1b554791351b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e6e8ef-eccb-4357-a77c-be3bc4dbb1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e6e8ef-eccb-4357-a77c-be3bc4dbb1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1582371772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5b8461-58fb-439f-86a3-1c77a717616e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a46868e2a3c4e52922cf252261c916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:09Z,use_quota=True,user_id='6136bd97ba0a45cfb745e3c2021fddf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cec5c66f-06a5-4144-8f6f-96d2e471c079),volume_type_id=cec5c66f-06a5-4144-8f6f-96d2e471c079)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc678600-939c-4fbb-8438-21343df4be75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc678600-939c-4fbb-8438-21343df4be75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99261baa-07e2-4c34-8b8d-5642effdc084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99261baa-07e2-4c34-8b8d-5642effdc084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e5b8461-58fb-439f-86a3-1c77a717616e', 'volume_name': 'volume-1e5b8461-58fb-439f-86a3-1c77a717616e', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348f743e-0a17-4987-bb8f-9a395f52bcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348f743e-0a17-4987-bb8f-9a395f52bcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae193826-57c1-4d99-97ab-1626e37cc219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:09 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Volume 1e5b8461-58fb-439f-86a3-1c77a717616e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e5b8461-58fb-439f-86a3-1c77a717616e', 'volume_size': 1} Jul 07 17:34:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:09 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a876eec3-f5f4-492b-8044-efe479cf21a2 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-72904dc4-1c9c-423c-beb3-3679f788a14f" returned: 0 in 1.220s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a876eec3-f5f4-492b-8044-efe479cf21a2 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-72904dc4-1c9c-423c-beb3-3679f788a14f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:09 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-72904dc4-1c9c-423c-beb3-3679f788a14f Jul 07 17:34:09 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:09 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ddec8801-48c3-4c60-b4a8-105315ad4876 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-702dc879-8fe8-4367-bfd4-35dea61b9ba6" returned: 0 in 1.417s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ddec8801-48c3-4c60-b4a8-105315ad4876 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-702dc879-8fe8-4367-bfd4-35dea61b9ba6 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:09 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-702dc879-8fe8-4367-bfd4-35dea61b9ba6 Jul 07 17:34:09 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:10 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0 1073741824" returned: 0 in 1.514s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:10 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0 Jul 07 17:34:10 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Flow 'volume_create_manager' (679224d5-43ca-4f7a-8e30-ac0bdcdd4699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdea3314-1a6b-480d-a716-3a910ffa0a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdea3314-1a6b-480d-a716-3a910ffa0a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-548284850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30da1435-61b9-4d93-9a96-9acac62fbf45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a46868e2a3c4e52922cf252261c916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:10Z,use_quota=True,user_id='6136bd97ba0a45cfb745e3c2021fddf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37450d2a-6269-4960-8967-0bbc7cd7e7fb),volume_type_id=37450d2a-6269-4960-8967-0bbc7cd7e7fb)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0a3701-2371-43d1-81d8-9e807531227d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0a3701-2371-43d1-81d8-9e807531227d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db3b88c-164f-4879-8802-94ba69ab7be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG cinder.image.glance [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Creating Keystone auth plugin from conf {{(pid=87303) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:34:10 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a876eec3-f5f4-492b-8044-efe479cf21a2 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-72904dc4-1c9c-423c-beb3-3679f788a14f" returned: 0 in 0.905s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a876eec3-f5f4-492b-8044-efe479cf21a2 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-quobyte-72904dc4-1c9c-423c-beb3-3679f788a14f" released by "delete_volume" :: held 2.202s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-a876eec3-f5f4-492b-8044-efe479cf21a2 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Created reservations ['e915bec8-4e55-4e11-ba0f-abfb6c1f2621', 'f8da5ac3-6028-4b2d-a7e6-d858d7828f49', 'c36b7c99-bedd-4b0e-af31-586bb2fabfe0', '93cca28f-b691-4fd6-847b-7fdd61bdbb78'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a876eec3-f5f4-492b-8044-efe479cf21a2 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a876eec3-f5f4-492b-8044-efe479cf21a2 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a876eec3-f5f4-492b-8044-efe479cf21a2 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a876eec3-f5f4-492b-8044-efe479cf21a2 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a876eec3-f5f4-492b-8044-efe479cf21a2 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a876eec3-f5f4-492b-8044-efe479cf21a2 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:10 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:34:10 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db3b88c-164f-4879-8802-94ba69ab7be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '30da1435-61b9-4d93-9a96-9acac62fbf45', 'volume_name': 'volume-30da1435-61b9-4d93-9a96-9acac62fbf45', 'volume_size': 1, 'image_id': '40a1b71d-3fc6-4f41-84b4-8a68b68cec53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40a1b71d-3fc6-4f41-84b4-8a68b68cec53', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--692807293', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8a46868e2a3c4e52922cf252261c916c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '40a1b71d-3fc6-4f41-84b4-8a68b68cec53', 'created_at': datetime.datetime(2026, 7, 7, 15, 34, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 34, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40a1b71d-3fc6-4f41-84b4-8a68b68cec53/file', 'properties': {}}, 'image_service': }' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19afdf45-684b-41db-9ac1-1c605e943e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19afdf45-684b-41db-9ac1-1c605e943e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e2c7fd-9264-4e1b-a00b-9264111d9cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:10 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Volume 30da1435-61b9-4d93-9a96-9acac62fbf45: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-30da1435-61b9-4d93-9a96-9acac62fbf45', 'volume_size': 1, 'image_id': '40a1b71d-3fc6-4f41-84b4-8a68b68cec53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40a1b71d-3fc6-4f41-84b4-8a68b68cec53', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--692807293', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8a46868e2a3c4e52922cf252261c916c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '40a1b71d-3fc6-4f41-84b4-8a68b68cec53', 'created_at': datetime.datetime(2026, 7, 7, 15, 34, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 34, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40a1b71d-3fc6-4f41-84b4-8a68b68cec53/file', 'properties': {}}, 'image_service': } Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Trying to clone 30da1435-61b9-4d93-9a96-9acac62fbf45 from image 40a1b71d-3fc6-4f41-84b4-8a68b68cec53 at location (None, [{'url': 'file:///opt/stack/data/glance/images/40a1b71d-3fc6-4f41-84b4-8a68b68cec53', 'metadata': {}}]). {{(pid=87303) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:34:10 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ddec8801-48c3-4c60-b4a8-105315ad4876 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-702dc879-8fe8-4367-bfd4-35dea61b9ba6" returned: 0 in 0.975s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ddec8801-48c3-4c60-b4a8-105315ad4876 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Lock "cinder-quobyte-702dc879-8fe8-4367-bfd4-35dea61b9ba6" released by "delete_volume" :: held 2.477s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-ddec8801-48c3-4c60-b4a8-105315ad4876 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Created reservations ['6b1acd31-bdb1-4f6d-8cbc-59814785ff7c', '4ef76566-6446-46fa-9eb3-8517c1cb1b58', '304f0d96-e955-4ab3-bb43-83570605d7af', '73228d74-446d-4c84-ae4e-61541da81978'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ddec8801-48c3-4c60-b4a8-105315ad4876 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ddec8801-48c3-4c60-b4a8-105315ad4876 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ddec8801-48c3-4c60-b4a8-105315ad4876 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ddec8801-48c3-4c60-b4a8-105315ad4876 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ddec8801-48c3-4c60-b4a8-105315ad4876 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ddec8801-48c3-4c60-b4a8-105315ad4876 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:11 devstack sudo[101530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:34:11 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:11 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0" returned: 0 in 0.999s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] <== create_volume: return (2587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.590s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.774s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1582371772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5b8461-58fb-439f-86a3-1c77a717616e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a46868e2a3c4e52922cf252261c916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:09Z,use_quota=True,user_id='6136bd97ba0a45cfb745e3c2021fddf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cec5c66f-06a5-4144-8f6f-96d2e471c079),volume_type_id=cec5c66f-06a5-4144-8f6f-96d2e471c079)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Creating volume 1e5b8461-58fb-439f-86a3-1c77a717616e {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:11 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1e5b8461-58fb-439f-86a3-1c77a717616e 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:11 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1e5b8461-58fb-439f-86a3-1c77a717616e 1073741824 Jul 07 17:34:11 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d752bbc-6ef2-423e-83f4-dd4bd2ab2a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b2fa138-404f-407d-b052-05ef94bd0d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:11 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Volume volume-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0 (efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0): created successfully Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b2fa138-404f-407d-b052-05ef94bd0d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Flow 'volume_create_manager' (7459fcbc-07b1-493d-9164-715ce35ab7c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:11 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-a06bab70-0181-46b1-ba93-90d0a5d7453d tempest-TestInstancesWithCinderVolumes-1817148846 None] Created volume successfully. Jul 07 17:34:11 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a876eec3-f5f4-492b-8044-efe479cf21a2 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.867s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-a876eec3-f5f4-492b-8044-efe479cf21a2 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:11 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-a876eec3-f5f4-492b-8044-efe479cf21a2 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Deleted volume successfully. Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a876eec3-f5f4-492b-8044-efe479cf21a2 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-72904dc4-1c9c-423c-beb3-3679f788a14f-delete_volume" released by "delete_volume" :: held 3.456s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-35bf3526-d1bb-4e68-bab8-6c81064f1dad tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "cinder-fb3ef0d7-618f-49a9-8c77-968a1c8d042d-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-35bf3526-d1bb-4e68-bab8-6c81064f1dad tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-fb3ef0d7-618f-49a9-8c77-968a1c8d042d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-35bf3526-d1bb-4e68-bab8-6c81064f1dad tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "cinder-quobyte-9cb74da1-717f-4706-b957-1c9bd123e138" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-35bf3526-d1bb-4e68-bab8-6c81064f1dad tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-quobyte-9cb74da1-717f-4706-b957-1c9bd123e138" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-35bf3526-d1bb-4e68-bab8-6c81064f1dad tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "cinder-quobyte-fb3ef0d7-618f-49a9-8c77-968a1c8d042d" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-35bf3526-d1bb-4e68-bab8-6c81064f1dad tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-quobyte-fb3ef0d7-618f-49a9-8c77-968a1c8d042d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-35bf3526-d1bb-4e68-bab8-6c81064f1dad tempest-CreateVolumesFromSnapshotTest-1141117255 None] Deleting offline snapshot fb3ef0d7-618f-49a9-8c77-968a1c8d042d of volume 9cb74da1-717f-4706-b957-1c9bd123e138 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-35bf3526-d1bb-4e68-bab8-6c81064f1dad tempest-CreateVolumesFromSnapshotTest-1141117255 None] snapshot_file for this snap is: volume-9cb74da1-717f-4706-b957-1c9bd123e138.fb3ef0d7-618f-49a9-8c77-968a1c8d042d {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[0046ca7f-db1b-4196-8bf1-55e569c22f34]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-35bf3526-d1bb-4e68-bab8-6c81064f1dad tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.fb3ef0d7-618f-49a9-8c77-968a1c8d042d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:12 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ddec8801-48c3-4c60-b4a8-105315ad4876 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.922s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:12 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-ddec8801-48c3-4c60-b4a8-105315ad4876 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:12 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-ddec8801-48c3-4c60-b4a8-105315ad4876 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Deleted volume successfully. Jul 07 17:34:12 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ddec8801-48c3-4c60-b4a8-105315ad4876 tempest-VolumeQuotasNegativeTestJSON-1192913817 None] Lock "cinder-702dc879-8fe8-4367-bfd4-35dea61b9ba6-delete_volume" released by "delete_volume" :: held 3.856s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:12 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.fb3ef0d7-618f-49a9-8c77-968a1c8d042d Jul 07 17:34:12 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:12 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1e5b8461-58fb-439f-86a3-1c77a717616e 1073741824" returned: 0 in 1.332s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1e5b8461-58fb-439f-86a3-1c77a717616e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:12 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1e5b8461-58fb-439f-86a3-1c77a717616e Jul 07 17:34:12 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:13 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-35bf3526-d1bb-4e68-bab8-6c81064f1dad tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.fb3ef0d7-618f-49a9-8c77-968a1c8d042d" returned: 0 in 1.429s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-35bf3526-d1bb-4e68-bab8-6c81064f1dad tempest-CreateVolumesFromSnapshotTest-1141117255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cb74da1-717f-4706-b957-1c9bd123e138(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:34:13 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee9d9c3-7fb5-45ab-a45f-88fec72ea58f]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-35bf3526-d1bb-4e68-bab8-6c81064f1dad tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:13 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:13 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138 Jul 07 17:34:13 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1e5b8461-58fb-439f-86a3-1c77a717616e" returned: 0 in 0.895s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] <== create_volume: return (2293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.298s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae193826-57c1-4d99-97ab-1626e37cc219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e5b8461-58fb-439f-86a3-1c77a717616e', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b3ddd4-3cc1-42ed-a211-7d257cdd6bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:13 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Volume volume-1e5b8461-58fb-439f-86a3-1c77a717616e (1e5b8461-58fb-439f-86a3-1c77a717616e): created successfully Jul 07 17:34:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b3ddd4-3cc1-42ed-a211-7d257cdd6bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Flow 'volume_create_manager' (648a0a49-50d5-4abb-b367-1b554791351b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:13 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-ea9642bf-71be-4bc3-885a-8841d5f5b5fb tempest-TestInstancesWithCinderVolumes-1817148846 None] Created volume successfully. Jul 07 17:34:14 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-35bf3526-d1bb-4e68-bab8-6c81064f1dad tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138" returned: 0 in 1.034s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-35bf3526-d1bb-4e68-bab8-6c81064f1dad tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.fb3ef0d7-618f-49a9-8c77-968a1c8d042d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:14 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.fb3ef0d7-618f-49a9-8c77-968a1c8d042d Jul 07 17:34:14 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:15 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-35bf3526-d1bb-4e68-bab8-6c81064f1dad tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.fb3ef0d7-618f-49a9-8c77-968a1c8d042d" returned: 0 in 1.054s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-35bf3526-d1bb-4e68-bab8-6c81064f1dad tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.fb3ef0d7-618f-49a9-8c77-968a1c8d042d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:15 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.fb3ef0d7-618f-49a9-8c77-968a1c8d042d Jul 07 17:34:15 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:15 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_40a1b71d-3fc6-4f41-84b4-8a68b68cec53_cftufqzedevstack@QuobyteHD, size 20.69 MB, duration 5.01 sec {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:34:15 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Image download 20.69 MB at 4.13 MB/s Jul 07 17:34:16 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7c035a-63cb-473a-a21f-a8b12cbc6ed5]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40a1b71d-3fc6-4f41-84b4-8a68b68cec53_cftufqzedevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:16 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40a1b71d-3fc6-4f41-84b4-8a68b68cec53_cftufqzedevstack@QuobyteHD Jul 07 17:34:16 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:16 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-35bf3526-d1bb-4e68-bab8-6c81064f1dad tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138.fb3ef0d7-618f-49a9-8c77-968a1c8d042d" returned: 0 in 0.917s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:16 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-35bf3526-d1bb-4e68-bab8-6c81064f1dad tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-quobyte-fb3ef0d7-618f-49a9-8c77-968a1c8d042d" released by "_delete_snapshot" :: held 4.609s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:16 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-35bf3526-d1bb-4e68-bab8-6c81064f1dad tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-quobyte-9cb74da1-717f-4706-b957-1c9bd123e138" released by "delete_snapshot" :: held 4.642s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:16 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-35bf3526-d1bb-4e68-bab8-6c81064f1dad tempest-CreateVolumesFromSnapshotTest-1141117255 None] Created reservations ['4ce4b65b-fe12-4e2e-a06a-68e831133413', '8da8198a-88d8-40fd-b887-ca36fccf7adb', '1e996dc3-e3d0-4a41-8fae-374aeea8caef', 'a088d606-dbed-4c0f-a37a-381f8b2621ba'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:16 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-35bf3526-d1bb-4e68-bab8-6c81064f1dad tempest-CreateVolumesFromSnapshotTest-1141117255 None] Delete snapshot completed successfully. Jul 07 17:34:16 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-35bf3526-d1bb-4e68-bab8-6c81064f1dad tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-fb3ef0d7-618f-49a9-8c77-968a1c8d042d-delete_snapshot" released by "delete_snapshot" :: held 4.842s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:16 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40a1b71d-3fc6-4f41-84b4-8a68b68cec53_cftufqzedevstack@QuobyteHD" returned: 0 in 0.967s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:16 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Temporary image 40a1b71d-3fc6-4f41-84b4-8a68b68cec53 is fetched for user 6136bd97ba0a45cfb745e3c2021fddf5. {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:34:17 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[f139504d-3060-4179-8c57-198f081afa53]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40a1b71d-3fc6-4f41-84b4-8a68b68cec53_cftufqzedevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b1f4dbcc-f79a-4c86-961f-b77dd1f54cf5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "cinder-9cb74da1-717f-4706-b957-1c9bd123e138-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:17 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40a1b71d-3fc6-4f41-84b4-8a68b68cec53_cftufqzedevstack@QuobyteHD Jul 07 17:34:17 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b1f4dbcc-f79a-4c86-961f-b77dd1f54cf5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-9cb74da1-717f-4706-b957-1c9bd123e138-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b1f4dbcc-f79a-4c86-961f-b77dd1f54cf5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "cinder-quobyte-9cb74da1-717f-4706-b957-1c9bd123e138" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b1f4dbcc-f79a-4c86-961f-b77dd1f54cf5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-quobyte-9cb74da1-717f-4706-b957-1c9bd123e138" acquired by "delete_volume" :: waited 0.024s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:17 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[665f4a4f-f639-4694-a418-545d22a1af30]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b1f4dbcc-f79a-4c86-961f-b77dd1f54cf5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:17 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138 Jul 07 17:34:17 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:18 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40a1b71d-3fc6-4f41-84b4-8a68b68cec53_cftufqzedevstack@QuobyteHD" returned: 0 in 0.938s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:18 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-548284850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30da1435-61b9-4d93-9a96-9acac62fbf45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a46868e2a3c4e52922cf252261c916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:10Z,use_quota=True,user_id='6136bd97ba0a45cfb745e3c2021fddf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37450d2a-6269-4960-8967-0bbc7cd7e7fb),volume_type_id=37450d2a-6269-4960-8967-0bbc7cd7e7fb)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:18 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Creating volume 30da1435-61b9-4d93-9a96-9acac62fbf45 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:18 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:18 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:18 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:18 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:34:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:18 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 1073741824 Jul 07 17:34:18 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:18 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b1f4dbcc-f79a-4c86-961f-b77dd1f54cf5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138" returned: 0 in 0.946s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b1f4dbcc-f79a-4c86-961f-b77dd1f54cf5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:18 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138 Jul 07 17:34:18 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:19 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 1073741824" returned: 0 in 1.050s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:19 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b1f4dbcc-f79a-4c86-961f-b77dd1f54cf5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9cb74da1-717f-4706-b957-1c9bd123e138" returned: 0 in 0.842s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:19 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 Jul 07 17:34:19 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b1f4dbcc-f79a-4c86-961f-b77dd1f54cf5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-quobyte-9cb74da1-717f-4706-b957-1c9bd123e138" released by "delete_volume" :: held 1.889s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:19 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-b1f4dbcc-f79a-4c86-961f-b77dd1f54cf5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Created reservations ['3c4bc28e-455b-4c62-b3b5-f70aea407c55', 'dd0a9c99-af8c-4c15-9b26-be9ad49efb05', 'a05af0e6-8d7d-4eee-b808-183f2ec5bdbc', '8471ff4c-47e0-47a9-8cc3-60084abea7ec'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b1f4dbcc-f79a-4c86-961f-b77dd1f54cf5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b1f4dbcc-f79a-4c86-961f-b77dd1f54cf5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b1f4dbcc-f79a-4c86-961f-b77dd1f54cf5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b1f4dbcc-f79a-4c86-961f-b77dd1f54cf5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b1f4dbcc-f79a-4c86-961f-b77dd1f54cf5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b1f4dbcc-f79a-4c86-961f-b77dd1f54cf5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:19 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:34:19 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:19 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Flow 'volume_create_manager' (d3590c43-2313-42fd-9507-42740ff87506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d250e6-b116-436a-9165-b9be0a51ec64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d250e6-b116-436a-9165-b9be0a51ec64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1712120429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d9ce95-a74c-4259-b897-0079bb01c9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366cbc6866bc45688b1fe8c27d34566d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:19Z,use_quota=True,user_id='75c3eaeb9fb34d97bc5d3365e21c7373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a82cb9-ad9c-4500-8332-857f029eb47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a82cb9-ad9c-4500-8332-857f029eb47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f7767c-6ac4-4583-9e9a-9c747df531a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f7767c-6ac4-4583-9e9a-9c747df531a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2d9ce95-a74c-4259-b897-0079bb01c9f1', 'volume_name': 'volume-c2d9ce95-a74c-4259-b897-0079bb01c9f1', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (135f87ba-a831-4ee6-a7c9-8c994db74494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (135f87ba-a831-4ee6-a7c9-8c994db74494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b7b82f6-d4a3-4755-8d4c-8b3629fe530c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:19 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Volume c2d9ce95-a74c-4259-b897-0079bb01c9f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2d9ce95-a74c-4259-b897-0079bb01c9f1', 'volume_size': 1} Jul 07 17:34:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:20 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45" returned: 0 in 0.884s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] <== create_volume: return (2006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.367s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1712120429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d9ce95-a74c-4259-b897-0079bb01c9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366cbc6866bc45688b1fe8c27d34566d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:19Z,use_quota=True,user_id='75c3eaeb9fb34d97bc5d3365e21c7373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Creating volume c2d9ce95-a74c-4259-b897-0079bb01c9f1 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:20 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:34:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2d9ce95-a74c-4259-b897-0079bb01c9f1 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:20 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2d9ce95-a74c-4259-b897-0079bb01c9f1 1073741824 Jul 07 17:34:20 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:20 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Attempting download of 40a1b71d-3fc6-4f41-84b4-8a68b68cec53 ((None, [{'url': 'file:///opt/stack/data/glance/images/40a1b71d-3fc6-4f41-84b4-8a68b68cec53', 'metadata': {}}])) to volume 30da1435-61b9-4d93-9a96-9acac62fbf45. {{(pid=87303) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:34:20 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[beda44f4-12f2-40b4-a7f6-b54950ab9bed]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40a1b71d-3fc6-4f41-84b4-8a68b68cec53_82mg_7dt {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:20 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40a1b71d-3fc6-4f41-84b4-8a68b68cec53_82mg_7dt Jul 07 17:34:20 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:20 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b1f4dbcc-f79a-4c86-961f-b77dd1f54cf5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.950s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:20 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-b1f4dbcc-f79a-4c86-961f-b77dd1f54cf5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:20 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b1f4dbcc-f79a-4c86-961f-b77dd1f54cf5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Deleted volume successfully. Jul 07 17:34:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-b1f4dbcc-f79a-4c86-961f-b77dd1f54cf5 tempest-CreateVolumesFromSnapshotTest-1141117255 None] Lock "cinder-9cb74da1-717f-4706-b957-1c9bd123e138-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:21 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40a1b71d-3fc6-4f41-84b4-8a68b68cec53_82mg_7dt" returned: 0 in 1.032s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40a1b71d-3fc6-4f41-84b4-8a68b68cec53_82mg_7dt {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:21 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2d9ce95-a74c-4259-b897-0079bb01c9f1 1073741824" returned: 0 in 1.206s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2d9ce95-a74c-4259-b897-0079bb01c9f1 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:21 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2d9ce95-a74c-4259-b897-0079bb01c9f1 Jul 07 17:34:21 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:21 devstack sudo[101607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40a1b71d-3fc6-4f41-84b4-8a68b68cec53_82mg_7dt Jul 07 17:34:21 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:22 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40a1b71d-3fc6-4f41-84b4-8a68b68cec53_82mg_7dt" returned: 1 in 0.955s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40a1b71d-3fc6-4f41-84b4-8a68b68cec53_82mg_7dt' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:34:22 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b9fbe2-63e5-4051-817d-6fad87778be8]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40a1b71d-3fc6-4f41-84b4-8a68b68cec53_cftufqzedevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:22 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2d9ce95-a74c-4259-b897-0079bb01c9f1" returned: 0 in 0.949s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] <== create_volume: return (2217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.221s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b7b82f6-d4a3-4755-8d4c-8b3629fe530c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2d9ce95-a74c-4259-b897-0079bb01c9f1', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e1deb3-3685-4913-94de-5cb88f3464c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:22 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Volume volume-c2d9ce95-a74c-4259-b897-0079bb01c9f1 (c2d9ce95-a74c-4259-b897-0079bb01c9f1): created successfully Jul 07 17:34:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e1deb3-3685-4913-94de-5cb88f3464c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Flow 'volume_create_manager' (d3590c43-2313-42fd-9507-42740ff87506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:22 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-a3f694d1-5d4f-4a31-a306-9b1307265865 tempest-AbsoluteLimitsTests-1190525931 None] Created volume successfully. Jul 07 17:34:22 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40a1b71d-3fc6-4f41-84b4-8a68b68cec53_cftufqzedevstack@QuobyteHD Jul 07 17:34:22 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:22 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-94333f08-dcf0-4116-9db9-6b1e4bebed3c tempest-AbsoluteLimitsTests-1190525931 None] Acquiring lock "cinder-c2d9ce95-a74c-4259-b897-0079bb01c9f1-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:22 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-94333f08-dcf0-4116-9db9-6b1e4bebed3c tempest-AbsoluteLimitsTests-1190525931 None] Lock "cinder-c2d9ce95-a74c-4259-b897-0079bb01c9f1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-94333f08-dcf0-4116-9db9-6b1e4bebed3c tempest-AbsoluteLimitsTests-1190525931 None] Acquiring lock "cinder-quobyte-c2d9ce95-a74c-4259-b897-0079bb01c9f1" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-94333f08-dcf0-4116-9db9-6b1e4bebed3c tempest-AbsoluteLimitsTests-1190525931 None] Lock "cinder-quobyte-c2d9ce95-a74c-4259-b897-0079bb01c9f1" acquired by "delete_volume" :: waited 0.023s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e338416-b504-4af6-ac13-080174b0c58c]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:23 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-94333f08-dcf0-4116-9db9-6b1e4bebed3c tempest-AbsoluteLimitsTests-1190525931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2d9ce95-a74c-4259-b897-0079bb01c9f1 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40a1b71d-3fc6-4f41-84b4-8a68b68cec53_cftufqzedevstack@QuobyteHD" returned: 0 in 0.938s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] 40a1b71d-3fc6-4f41-84b4-8a68b68cec53 was qcow2, converting to raw {{(pid=87303) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_40a1b71d-3fc6-4f41-84b4-8a68b68cec53_cftufqzedevstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:23 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_40a1b71d-3fc6-4f41-84b4-8a68b68cec53_cftufqzedevstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 Jul 07 17:34:23 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:23 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2d9ce95-a74c-4259-b897-0079bb01c9f1 Jul 07 17:34:23 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Flow 'volume_create_manager' (1cddc5c6-fb95-4856-9dad-87067ea15190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b103c853-f3a1-4bcf-82c0-92bcac0fc71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b103c853-f3a1-4bcf-82c0-92bcac0fc71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1931590352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6551f3ee-3105-4da1-9c9d-e7ff23287bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32329a670d45496b8ef8a3ddcef13587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:23Z,use_quota=True,user_id='4e17fc2db10547a9b74ef2ebd76f950c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f32d9e-4714-4297-8614-96468f159ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f32d9e-4714-4297-8614-96468f159ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add98dd7-ec1f-407d-af7f-57326a011dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add98dd7-ec1f-407d-af7f-57326a011dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6551f3ee-3105-4da1-9c9d-e7ff23287bbc', 'volume_name': 'volume-6551f3ee-3105-4da1-9c9d-e7ff23287bbc', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6088b014-92bf-45be-9deb-83b7c501d7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6088b014-92bf-45be-9deb-83b7c501d7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38b95dc-c45d-4dbe-841b-32c6da367fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:23 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Volume 6551f3ee-3105-4da1-9c9d-e7ff23287bbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6551f3ee-3105-4da1-9c9d-e7ff23287bbc', 'volume_size': 1} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1931590352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6551f3ee-3105-4da1-9c9d-e7ff23287bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32329a670d45496b8ef8a3ddcef13587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:23Z,use_quota=True,user_id='4e17fc2db10547a9b74ef2ebd76f950c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Creating volume 6551f3ee-3105-4da1-9c9d-e7ff23287bbc {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:23 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:34:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6551f3ee-3105-4da1-9c9d-e7ff23287bbc 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:23 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6551f3ee-3105-4da1-9c9d-e7ff23287bbc 1073741824 Jul 07 17:34:23 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:24 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-94333f08-dcf0-4116-9db9-6b1e4bebed3c tempest-AbsoluteLimitsTests-1190525931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2d9ce95-a74c-4259-b897-0079bb01c9f1" returned: 0 in 1.005s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-94333f08-dcf0-4116-9db9-6b1e4bebed3c tempest-AbsoluteLimitsTests-1190525931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2d9ce95-a74c-4259-b897-0079bb01c9f1 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:24 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2d9ce95-a74c-4259-b897-0079bb01c9f1 Jul 07 17:34:24 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:24 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6551f3ee-3105-4da1-9c9d-e7ff23287bbc 1073741824" returned: 0 in 1.206s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6551f3ee-3105-4da1-9c9d-e7ff23287bbc {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:24 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6551f3ee-3105-4da1-9c9d-e7ff23287bbc Jul 07 17:34:24 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:24 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-94333f08-dcf0-4116-9db9-6b1e4bebed3c tempest-AbsoluteLimitsTests-1190525931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2d9ce95-a74c-4259-b897-0079bb01c9f1" returned: 0 in 0.816s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-94333f08-dcf0-4116-9db9-6b1e4bebed3c tempest-AbsoluteLimitsTests-1190525931 None] Lock "cinder-quobyte-c2d9ce95-a74c-4259-b897-0079bb01c9f1" released by "delete_volume" :: held 1.896s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:25 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-94333f08-dcf0-4116-9db9-6b1e4bebed3c tempest-AbsoluteLimitsTests-1190525931 None] Created reservations ['d562e091-cdb5-41c1-b996-e7aab0c525d3', 'd06a8d2d-3ffa-4c00-b81b-59fd8d11c2ac', '6d53fac2-a3c6-4995-9ff2-fb7fb945bf26', '4e01940b-d3dd-4ee5-a588-0f2b27b4e823'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-94333f08-dcf0-4116-9db9-6b1e4bebed3c tempest-AbsoluteLimitsTests-1190525931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-94333f08-dcf0-4116-9db9-6b1e4bebed3c tempest-AbsoluteLimitsTests-1190525931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-94333f08-dcf0-4116-9db9-6b1e4bebed3c tempest-AbsoluteLimitsTests-1190525931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-94333f08-dcf0-4116-9db9-6b1e4bebed3c tempest-AbsoluteLimitsTests-1190525931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-94333f08-dcf0-4116-9db9-6b1e4bebed3c tempest-AbsoluteLimitsTests-1190525931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-94333f08-dcf0-4116-9db9-6b1e4bebed3c tempest-AbsoluteLimitsTests-1190525931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:25 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:34:25 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:25 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_40a1b71d-3fc6-4f41-84b4-8a68b68cec53_cftufqzedevstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45" returned: 0 in 2.577s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:25 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_40a1b71d-3fc6-4f41-84b4-8a68b68cec53_cftufqzedevstack@QuobyteHD, size 112.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:34:25 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Converted 112.00 MB image at 43.41 MB/s Jul 07 17:34:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:25 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 1G Jul 07 17:34:25 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:25 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6551f3ee-3105-4da1-9c9d-e7ff23287bbc" returned: 0 in 0.956s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] <== create_volume: return (2224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.228s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38b95dc-c45d-4dbe-841b-32c6da367fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6551f3ee-3105-4da1-9c9d-e7ff23287bbc', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5345c7a2-0f9b-498a-a2ae-3bab1ef4fe61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:25 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Volume volume-6551f3ee-3105-4da1-9c9d-e7ff23287bbc (6551f3ee-3105-4da1-9c9d-e7ff23287bbc): created successfully Jul 07 17:34:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5345c7a2-0f9b-498a-a2ae-3bab1ef4fe61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Flow 'volume_create_manager' (1cddc5c6-fb95-4856-9dad-87067ea15190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:25 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-3c99959c-94e4-42fa-8e53-dda655a48060 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Created volume successfully. Jul 07 17:34:26 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-94333f08-dcf0-4116-9db9-6b1e4bebed3c tempest-AbsoluteLimitsTests-1190525931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.961s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:26 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-94333f08-dcf0-4116-9db9-6b1e4bebed3c tempest-AbsoluteLimitsTests-1190525931 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:26 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-94333f08-dcf0-4116-9db9-6b1e4bebed3c tempest-AbsoluteLimitsTests-1190525931 None] Deleted volume successfully. Jul 07 17:34:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-94333f08-dcf0-4116-9db9-6b1e4bebed3c tempest-AbsoluteLimitsTests-1190525931 None] Lock "cinder-c2d9ce95-a74c-4259-b897-0079bb01c9f1-delete_volume" released by "delete_volume" :: held 3.192s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:26 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 1G" returned: 0 in 1.010s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:26 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fdf798-75cd-4d3a-8200-9324db062c43]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:26 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 Jul 07 17:34:26 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:27 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:27 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Flow 'volume_create_manager' (f245d7ce-5d5e-49ee-acac-26ceb6adbd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:27 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0f4ce5-ea9c-4f37-9788-5977da002b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:27 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0f4ce5-ea9c-4f37-9788-5977da002b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-133975483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9713cff-76eb-45bc-b904-1ebd217f0dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32329a670d45496b8ef8a3ddcef13587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:27Z,use_quota=True,user_id='4e17fc2db10547a9b74ef2ebd76f950c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:27 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c8c0b3-d4b6-46b0-b1cd-dd2f5bc270c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:27 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c8c0b3-d4b6-46b0-b1cd-dd2f5bc270c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:27 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e927fca7-9de2-42ea-9f59-b4f317043669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:27 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e927fca7-9de2-42ea-9f59-b4f317043669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9713cff-76eb-45bc-b904-1ebd217f0dfc', 'volume_name': 'volume-e9713cff-76eb-45bc-b904-1ebd217f0dfc', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:27 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8e499a-e533-49fc-bf54-1ba5270bdf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:27 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8e499a-e533-49fc-bf54-1ba5270bdf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:27 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ffede21-b306-435a-939e-995e22f1d1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:27 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Volume e9713cff-76eb-45bc-b904-1ebd217f0dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9713cff-76eb-45bc-b904-1ebd217f0dfc', 'volume_size': 1} Jul 07 17:34:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-133975483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9713cff-76eb-45bc-b904-1ebd217f0dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32329a670d45496b8ef8a3ddcef13587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:27Z,use_quota=True,user_id='4e17fc2db10547a9b74ef2ebd76f950c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Creating volume e9713cff-76eb-45bc-b904-1ebd217f0dfc {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:27 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:34:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e9713cff-76eb-45bc-b904-1ebd217f0dfc 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:27 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e9713cff-76eb-45bc-b904-1ebd217f0dfc 1073741824 Jul 07 17:34:27 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Flow 'volume_create_manager' (ec021586-5b35-43f6-abb1-0105510d2e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4cd269-108c-4b99-8139-f7be5829d67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4cd269-108c-4b99-8139-f7be5829d67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1490088956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0dff92e-567a-445c-8dc6-f0609ff14323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32329a670d45496b8ef8a3ddcef13587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:28Z,use_quota=True,user_id='4e17fc2db10547a9b74ef2ebd76f950c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a424f7-1166-4b83-b8c9-3802aa84f2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a424f7-1166-4b83-b8c9-3802aa84f2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162d77c3-f6b3-4e42-a5e5-6caf0eb4b5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162d77c3-f6b3-4e42-a5e5-6caf0eb4b5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0dff92e-567a-445c-8dc6-f0609ff14323', 'volume_name': 'volume-c0dff92e-567a-445c-8dc6-f0609ff14323', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a199e877-e443-4eb9-a4e6-4ff2766ef74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a199e877-e443-4eb9-a4e6-4ff2766ef74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b017404-9439-410d-81ce-90b8e1126c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:28 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Volume c0dff92e-567a-445c-8dc6-f0609ff14323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0dff92e-567a-445c-8dc6-f0609ff14323', 'volume_size': 1} Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:28 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45" returned: 0 in 1.514s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:28 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 Jul 07 17:34:28 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Flow 'volume_create_manager' (579acbf7-b22c-4a58-ba39-21f122c2652c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25299ded-34ea-4bf0-a841-2399ede1c6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25299ded-34ea-4bf0-a841-2399ede1c6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-101798722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76338c3a-f76f-45ad-a48b-ecbe4ff19bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32329a670d45496b8ef8a3ddcef13587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:29Z,use_quota=True,user_id='4e17fc2db10547a9b74ef2ebd76f950c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abfca3cf-b772-4e80-aa7c-edd6bde5b2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abfca3cf-b772-4e80-aa7c-edd6bde5b2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9726f559-0d36-4ff2-989d-3a01d8604dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9726f559-0d36-4ff2-989d-3a01d8604dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76338c3a-f76f-45ad-a48b-ecbe4ff19bc2', 'volume_name': 'volume-76338c3a-f76f-45ad-a48b-ecbe4ff19bc2', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (133bd2c2-54f7-4446-8651-df64983ef560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (133bd2c2-54f7-4446-8651-df64983ef560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a59229-d7a9-47b9-88cc-82e05fa99f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:28 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Volume 76338c3a-f76f-45ad-a48b-ecbe4ff19bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76338c3a-f76f-45ad-a48b-ecbe4ff19bc2', 'volume_size': 1} Jul 07 17:34:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:29 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e9713cff-76eb-45bc-b904-1ebd217f0dfc 1073741824" returned: 0 in 1.761s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Flow 'volume_create_manager' (1d4e2cd0-1a72-45f4-8251-3bf0fc797152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe5b280-401c-4ea8-b423-0c91eb0443a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e9713cff-76eb-45bc-b904-1ebd217f0dfc {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:29 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e9713cff-76eb-45bc-b904-1ebd217f0dfc Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe5b280-401c-4ea8-b423-0c91eb0443a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1995046017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c3fd1c-e74d-4561-a11e-d580034cf0cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32329a670d45496b8ef8a3ddcef13587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:29Z,use_quota=True,user_id='4e17fc2db10547a9b74ef2ebd76f950c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:29 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b257b56-2e20-41d2-a747-6d6d72d11d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b257b56-2e20-41d2-a747-6d6d72d11d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62014c6-0949-4fec-a4c9-40b0af1b46bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62014c6-0949-4fec-a4c9-40b0af1b46bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87c3fd1c-e74d-4561-a11e-d580034cf0cf', 'volume_name': 'volume-87c3fd1c-e74d-4561-a11e-d580034cf0cf', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25f0cb8-998c-4feb-8cb3-cd638802405b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25f0cb8-998c-4feb-8cb3-cd638802405b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f80f71-66f4-4c17-b6d6-08586ae0a05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:29 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Volume 87c3fd1c-e74d-4561-a11e-d580034cf0cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87c3fd1c-e74d-4561-a11e-d580034cf0cf', 'volume_size': 1} Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:29 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45" returned: 1 in 1.459s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Downloaded image 40a1b71d-3fc6-4f41-84b4-8a68b68cec53 ((None, [{'url': 'file:///opt/stack/data/glance/images/40a1b71d-3fc6-4f41-84b4-8a68b68cec53', 'metadata': {}}])) to volume 30da1435-61b9-4d93-9a96-9acac62fbf45 successfully. {{(pid=87303) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Temporary image 40a1b71d-3fc6-4f41-84b4-8a68b68cec53 for user 6136bd97ba0a45cfb745e3c2021fddf5 is deleted. {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Marking volume 30da1435-61b9-4d93-9a96-9acac62fbf45 as bootable. {{(pid=87303) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Copying metadata from image 40a1b71d-3fc6-4f41-84b4-8a68b68cec53 to 30da1435-61b9-4d93-9a96-9acac62fbf45. {{(pid=87303) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Creating volume glance metadata for volume 30da1435-61b9-4d93-9a96-9acac62fbf45 backed by image 40a1b71d-3fc6-4f41-84b4-8a68b68cec53 with: {'image_id': '40a1b71d-3fc6-4f41-84b4-8a68b68cec53', 'image_name': 'tempest-scenario-img--692807293', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87303) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e2c7fd-9264-4e1b-a00b-9264111d9cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30da1435-61b9-4d93-9a96-9acac62fbf45', 'volume_size': 1, 'image_id': '40a1b71d-3fc6-4f41-84b4-8a68b68cec53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40a1b71d-3fc6-4f41-84b4-8a68b68cec53', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--692807293', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8a46868e2a3c4e52922cf252261c916c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '40a1b71d-3fc6-4f41-84b4-8a68b68cec53', 'created_at': datetime.datetime(2026, 7, 7, 15, 34, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 34, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40a1b71d-3fc6-4f41-84b4-8a68b68cec53/file', 'properties': {}}, 'image_service': }' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2a8fe7-72bd-40d9-bba4-f847428ed2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:29 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Volume volume-30da1435-61b9-4d93-9a96-9acac62fbf45 (30da1435-61b9-4d93-9a96-9acac62fbf45): created successfully Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2a8fe7-72bd-40d9-bba4-f847428ed2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Flow 'volume_create_manager' (679224d5-43ca-4f7a-8e30-ac0bdcdd4699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:30 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-9b69bebd-f4f4-497a-b81b-8e853bf9a51f tempest-TestInstancesWithCinderVolumes-1817148846 None] Created volume successfully. Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Flow 'volume_create_manager' (a6b85d15-bce9-472a-a593-d07571f691cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6762f838-f745-4e23-a269-2c493d11b039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6762f838-f745-4e23-a269-2c493d11b039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1979325280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b939e7-d830-4f2e-831c-e4f4151001fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32329a670d45496b8ef8a3ddcef13587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:30Z,use_quota=True,user_id='4e17fc2db10547a9b74ef2ebd76f950c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c7adf2-7532-4308-b5aa-9ee47e325aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c7adf2-7532-4308-b5aa-9ee47e325aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a75b29d-caa0-4b8c-90dc-0e76e2220c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a75b29d-caa0-4b8c-90dc-0e76e2220c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8b939e7-d830-4f2e-831c-e4f4151001fb', 'volume_name': 'volume-c8b939e7-d830-4f2e-831c-e4f4151001fb', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f4ced37-d09d-4de6-83ad-8a564e81ab79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f4ced37-d09d-4de6-83ad-8a564e81ab79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4733ce00-3bf0-439a-9ff1-8fc3bb898ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:30 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Volume c8b939e7-d830-4f2e-831c-e4f4151001fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8b939e7-d830-4f2e-831c-e4f4151001fb', 'volume_size': 1} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:30 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e9713cff-76eb-45bc-b904-1ebd217f0dfc" returned: 0 in 0.947s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] <== create_volume: return (2824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.827s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.238s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1490088956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0dff92e-567a-445c-8dc6-f0609ff14323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32329a670d45496b8ef8a3ddcef13587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:28Z,use_quota=True,user_id='4e17fc2db10547a9b74ef2ebd76f950c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Creating volume c0dff92e-567a-445c-8dc6-f0609ff14323 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:30 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c0dff92e-567a-445c-8dc6-f0609ff14323 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ffede21-b306-435a-939e-995e22f1d1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9713cff-76eb-45bc-b904-1ebd217f0dfc', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:30 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c0dff92e-567a-445c-8dc6-f0609ff14323 1073741824 Jul 07 17:34:30 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd93f2e-d01c-4435-a975-f24b854897c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:30 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Volume volume-e9713cff-76eb-45bc-b904-1ebd217f0dfc (e9713cff-76eb-45bc-b904-1ebd217f0dfc): created successfully Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd93f2e-d01c-4435-a975-f24b854897c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Flow 'volume_create_manager' (f245d7ce-5d5e-49ee-acac-26ceb6adbd41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:30 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-e75a64a1-c958-4e38-9a25-9d7716c2deff tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Created volume successfully. Jul 07 17:34:31 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c0dff92e-567a-445c-8dc6-f0609ff14323 1073741824" returned: 0 in 1.120s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c0dff92e-567a-445c-8dc6-f0609ff14323 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:31 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c0dff92e-567a-445c-8dc6-f0609ff14323 Jul 07 17:34:31 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Flow 'volume_create_manager' (beb969e3-4f98-4b51-92db-596dab596df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a03116-7764-4ea8-8d0f-3117e7faa838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a03116-7764-4ea8-8d0f-3117e7faa838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-714965250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced0f2de-2065-4d27-8cdf-c30c3cfd2876,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7dd0196c724342fba9d45a65f3e4a3a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:32Z,use_quota=True,user_id='ba64094d4b024ba88dff6f7001440f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1871c32-05b9-47b5-9c09-a77cf8ff3ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1871c32-05b9-47b5-9c09-a77cf8ff3ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7b36f2-5ec8-4696-93af-8b09b7944157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7b36f2-5ec8-4696-93af-8b09b7944157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ced0f2de-2065-4d27-8cdf-c30c3cfd2876', 'volume_name': 'volume-ced0f2de-2065-4d27-8cdf-c30c3cfd2876', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232f6764-591c-4537-a369-a9f5e780e995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232f6764-591c-4537-a369-a9f5e780e995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08bba527-f2b5-48eb-aba1-1a57d2708c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:32 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Volume ced0f2de-2065-4d27-8cdf-c30c3cfd2876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ced0f2de-2065-4d27-8cdf-c30c3cfd2876', 'volume_size': 1} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:32 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c0dff92e-567a-445c-8dc6-f0609ff14323" returned: 0 in 0.850s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.041s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.508s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-101798722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76338c3a-f76f-45ad-a48b-ecbe4ff19bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32329a670d45496b8ef8a3ddcef13587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:29Z,use_quota=True,user_id='4e17fc2db10547a9b74ef2ebd76f950c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Creating volume 76338c3a-f76f-45ad-a48b-ecbe4ff19bc2 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:32 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-76338c3a-f76f-45ad-a48b-ecbe4ff19bc2 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b017404-9439-410d-81ce-90b8e1126c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0dff92e-567a-445c-8dc6-f0609ff14323', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:32 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-76338c3a-f76f-45ad-a48b-ecbe4ff19bc2 1073741824 Jul 07 17:34:32 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5751acdd-b328-4978-963b-0c1072f2518a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:32 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Volume volume-c0dff92e-567a-445c-8dc6-f0609ff14323 (c0dff92e-567a-445c-8dc6-f0609ff14323): created successfully Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5751acdd-b328-4978-963b-0c1072f2518a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Flow 'volume_create_manager' (ec021586-5b35-43f6-abb1-0105510d2e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:32 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-12a1d75e-1e44-4d47-ba33-ee27ac0336ba tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Created volume successfully. Jul 07 17:34:33 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-76338c3a-f76f-45ad-a48b-ecbe4ff19bc2 1073741824" returned: 0 in 1.079s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-76338c3a-f76f-45ad-a48b-ecbe4ff19bc2 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:33 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-76338c3a-f76f-45ad-a48b-ecbe4ff19bc2 Jul 07 17:34:33 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:34 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-76338c3a-f76f-45ad-a48b-ecbe4ff19bc2" returned: 0 in 0.776s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.817s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1995046017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c3fd1c-e74d-4561-a11e-d580034cf0cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32329a670d45496b8ef8a3ddcef13587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:29Z,use_quota=True,user_id='4e17fc2db10547a9b74ef2ebd76f950c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Creating volume 87c3fd1c-e74d-4561-a11e-d580034cf0cf {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:34 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:34:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-87c3fd1c-e74d-4561-a11e-d580034cf0cf 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a59229-d7a9-47b9-88cc-82e05fa99f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76338c3a-f76f-45ad-a48b-ecbe4ff19bc2', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:34 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-87c3fd1c-e74d-4561-a11e-d580034cf0cf 1073741824 Jul 07 17:34:34 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2671a2b-9ba3-4aa0-bf92-12d85ca3451d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:34 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Volume volume-76338c3a-f76f-45ad-a48b-ecbe4ff19bc2 (76338c3a-f76f-45ad-a48b-ecbe4ff19bc2): created successfully Jul 07 17:34:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2671a2b-9ba3-4aa0-bf92-12d85ca3451d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Flow 'volume_create_manager' (579acbf7-b22c-4a58-ba39-21f122c2652c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:34 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-4f6aead4-18ee-45dc-a75c-875dc2a9b711 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Created volume successfully. Jul 07 17:34:35 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-87c3fd1c-e74d-4561-a11e-d580034cf0cf 1073741824" returned: 0 in 1.053s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-87c3fd1c-e74d-4561-a11e-d580034cf0cf {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:35 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-87c3fd1c-e74d-4561-a11e-d580034cf0cf Jul 07 17:34:35 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:36 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-87c3fd1c-e74d-4561-a11e-d580034cf0cf" returned: 0 in 0.779s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.985s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1979325280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b939e7-d830-4f2e-831c-e4f4151001fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32329a670d45496b8ef8a3ddcef13587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:30Z,use_quota=True,user_id='4e17fc2db10547a9b74ef2ebd76f950c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Creating volume c8b939e7-d830-4f2e-831c-e4f4151001fb {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:36 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:34:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c8b939e7-d830-4f2e-831c-e4f4151001fb 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:36 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c8b939e7-d830-4f2e-831c-e4f4151001fb 1073741824 Jul 07 17:34:36 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f80f71-66f4-4c17-b6d6-08586ae0a05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87c3fd1c-e74d-4561-a11e-d580034cf0cf', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba9f8eb-7ac1-4833-9114-ee77c2f63f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:36 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Volume volume-87c3fd1c-e74d-4561-a11e-d580034cf0cf (87c3fd1c-e74d-4561-a11e-d580034cf0cf): created successfully Jul 07 17:34:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba9f8eb-7ac1-4833-9114-ee77c2f63f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Flow 'volume_create_manager' (1d4e2cd0-1a72-45f4-8251-3bf0fc797152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:36 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5ecdbe57-2e43-4c62-9b66-e39633752925 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Created volume successfully. Jul 07 17:34:37 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c8b939e7-d830-4f2e-831c-e4f4151001fb 1073741824" returned: 0 in 1.013s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c8b939e7-d830-4f2e-831c-e4f4151001fb {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:37 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c8b939e7-d830-4f2e-831c-e4f4151001fb Jul 07 17:34:37 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:38 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c8b939e7-d830-4f2e-831c-e4f4151001fb" returned: 0 in 0.790s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.966s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-714965250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced0f2de-2065-4d27-8cdf-c30c3cfd2876,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7dd0196c724342fba9d45a65f3e4a3a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:32Z,use_quota=True,user_id='ba64094d4b024ba88dff6f7001440f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Creating volume ced0f2de-2065-4d27-8cdf-c30c3cfd2876 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:38 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:34:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ced0f2de-2065-4d27-8cdf-c30c3cfd2876 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4733ce00-3bf0-439a-9ff1-8fc3bb898ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8b939e7-d830-4f2e-831c-e4f4151001fb', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:38 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ced0f2de-2065-4d27-8cdf-c30c3cfd2876 1073741824 Jul 07 17:34:38 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d960a614-9ae9-4b22-b283-90fd86943539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:38 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Volume volume-c8b939e7-d830-4f2e-831c-e4f4151001fb (c8b939e7-d830-4f2e-831c-e4f4151001fb): created successfully Jul 07 17:34:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d960a614-9ae9-4b22-b283-90fd86943539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Flow 'volume_create_manager' (a6b85d15-bce9-472a-a593-d07571f691cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:38 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-aa2cf7b8-cff5-4d51-b0f8-28856013f715 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Created volume successfully. Jul 07 17:34:39 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-67100172-22c3-442c-a6ee-eedc2e7a3133 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "cinder-c8b939e7-d830-4f2e-831c-e4f4151001fb-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:39 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-67100172-22c3-442c-a6ee-eedc2e7a3133 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-c8b939e7-d830-4f2e-831c-e4f4151001fb-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:39 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-67100172-22c3-442c-a6ee-eedc2e7a3133 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "cinder-quobyte-c8b939e7-d830-4f2e-831c-e4f4151001fb" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:39 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-67100172-22c3-442c-a6ee-eedc2e7a3133 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-quobyte-c8b939e7-d830-4f2e-831c-e4f4151001fb" acquired by "delete_volume" :: waited 0.023s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:39 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb71303-2bc1-423d-849e-715ee7df7e3e]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-67100172-22c3-442c-a6ee-eedc2e7a3133 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c8b939e7-d830-4f2e-831c-e4f4151001fb {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:39 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ced0f2de-2065-4d27-8cdf-c30c3cfd2876 1073741824" returned: 0 in 1.415s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ced0f2de-2065-4d27-8cdf-c30c3cfd2876 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:39 devstack sudo[101723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c8b939e7-d830-4f2e-831c-e4f4151001fb Jul 07 17:34:39 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:39 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ced0f2de-2065-4d27-8cdf-c30c3cfd2876 Jul 07 17:34:39 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-7f87a0e3-e1fe-4b1b-bb58-68c8d214ffc4 req-89450247-00e4-492d-98ce-a22b18ab1f6e tempest-TestInstancesWithCinderVolumes-1817148846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:40 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ced0f2de-2065-4d27-8cdf-c30c3cfd2876" returned: 0 in 0.858s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:40 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] <== create_volume: return (2332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.336s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-7f87a0e3-e1fe-4b1b-bb58-68c8d214ffc4 req-89450247-00e4-492d-98ce-a22b18ab1f6e tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.501s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08bba527-f2b5-48eb-aba1-1a57d2708c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced0f2de-2065-4d27-8cdf-c30c3cfd2876', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e653938-53de-4714-adc1-99c214611ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:40 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Volume volume-ced0f2de-2065-4d27-8cdf-c30c3cfd2876 (ced0f2de-2065-4d27-8cdf-c30c3cfd2876): created successfully Jul 07 17:34:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e653938-53de-4714-adc1-99c214611ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:40 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Flow 'volume_create_manager' (beb969e3-4f98-4b51-92db-596dab596df1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-67100172-22c3-442c-a6ee-eedc2e7a3133 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c8b939e7-d830-4f2e-831c-e4f4151001fb" returned: 0 in 1.184s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-67100172-22c3-442c-a6ee-eedc2e7a3133 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c8b939e7-d830-4f2e-831c-e4f4151001fb {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:40 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c86d026-cffb-4821-a626-6d75a2cf6e61]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-7f87a0e3-e1fe-4b1b-bb58-68c8d214ffc4 req-89450247-00e4-492d-98ce-a22b18ab1f6e tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:40 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c8b939e7-d830-4f2e-831c-e4f4151001fb Jul 07 17:34:40 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:40 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-986ea814-ced2-4c7f-8c4a-8fe002c18e25 tempest-VolumesListTestJSON-2012880951 None] Created volume successfully. Jul 07 17:34:40 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 Jul 07 17:34:40 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:41 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-67100172-22c3-442c-a6ee-eedc2e7a3133 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c8b939e7-d830-4f2e-831c-e4f4151001fb" returned: 0 in 0.863s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:41 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-67100172-22c3-442c-a6ee-eedc2e7a3133 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-quobyte-c8b939e7-d830-4f2e-831c-e4f4151001fb" released by "delete_volume" :: held 2.119s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:41 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-7f87a0e3-e1fe-4b1b-bb58-68c8d214ffc4 req-89450247-00e4-492d-98ce-a22b18ab1f6e tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45" returned: 0 in 0.952s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-7f87a0e3-e1fe-4b1b-bb58-68c8d214ffc4 req-89450247-00e4-492d-98ce-a22b18ab1f6e tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:41 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-67100172-22c3-442c-a6ee-eedc2e7a3133 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Created reservations ['fef4f121-9b0f-41ba-9fd7-c3550cf2eea5', '8a86fc63-4df4-4917-b416-6d412d554a44', '4f2ad885-416c-42ca-8366-456dde123ae7', 'ea852a24-de00-4be1-a699-f8ad847919da'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-67100172-22c3-442c-a6ee-eedc2e7a3133 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-67100172-22c3-442c-a6ee-eedc2e7a3133 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:41 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-67100172-22c3-442c-a6ee-eedc2e7a3133 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:41 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-67100172-22c3-442c-a6ee-eedc2e7a3133 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-67100172-22c3-442c-a6ee-eedc2e7a3133 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-67100172-22c3-442c-a6ee-eedc2e7a3133 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:41 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 Jul 07 17:34:41 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:41 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:34:41 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Flow 'volume_create_manager' (61e012bd-854f-4416-8f4f-d1b563c78d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b26f605-d534-44ce-80f0-3e6f124a5cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b26f605-d534-44ce-80f0-3e6f124a5cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-917141794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e8a63b-79c4-4f60-81a1-9353333eb17d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7dd0196c724342fba9d45a65f3e4a3a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:42Z,use_quota=True,user_id='ba64094d4b024ba88dff6f7001440f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aabb653a-97db-4414-a93d-c4a32b5d8c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aabb653a-97db-4414-a93d-c4a32b5d8c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:42 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349d7c91-d078-4f65-b01b-678bab79dc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349d7c91-d078-4f65-b01b-678bab79dc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91e8a63b-79c4-4f60-81a1-9353333eb17d', 'volume_name': 'volume-91e8a63b-79c4-4f60-81a1-9353333eb17d', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c73dd6-f11b-482e-a6f0-4ababcfa690b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c73dd6-f11b-482e-a6f0-4ababcfa690b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5799ab54-15ed-458b-a271-49d92b40552c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:42 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Volume 91e8a63b-79c4-4f60-81a1-9353333eb17d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91e8a63b-79c4-4f60-81a1-9353333eb17d', 'volume_size': 1} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-7f87a0e3-e1fe-4b1b-bb58-68c8d214ffc4 req-89450247-00e4-492d-98ce-a22b18ab1f6e tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45" returned: 1 in 1.014s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-7f87a0e3-e1fe-4b1b-bb58-68c8d214ffc4 req-89450247-00e4-492d-98ce-a22b18ab1f6e tempest-TestInstancesWithCinderVolumes-1817148846 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-7f87a0e3-e1fe-4b1b-bb58-68c8d214ffc4 req-89450247-00e4-492d-98ce-a22b18ab1f6e tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.074s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-917141794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e8a63b-79c4-4f60-81a1-9353333eb17d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7dd0196c724342fba9d45a65f3e4a3a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:42Z,use_quota=True,user_id='ba64094d4b024ba88dff6f7001440f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Creating volume 91e8a63b-79c4-4f60-81a1-9353333eb17d {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:42 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-91e8a63b-79c4-4f60-81a1-9353333eb17d 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:42 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-91e8a63b-79c4-4f60-81a1-9353333eb17d 1073741824 Jul 07 17:34:42 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-7f87a0e3-e1fe-4b1b-bb58-68c8d214ffc4 req-89450247-00e4-492d-98ce-a22b18ab1f6e tempest-TestInstancesWithCinderVolumes-1817148846 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2', 'name': 'volume-30da1435-61b9-4d93-9a96-9acac62fbf45', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '768095d5-3136-4fc1-b106-2bb6acaa004f', 'enforce_multipath': True} {{(pid=87303) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:34:42 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-109547c8-7a26-4770-836c-506ab08caf48 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "cinder-87c3fd1c-e74d-4561-a11e-d580034cf0cf-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-67100172-22c3-442c-a6ee-eedc2e7a3133 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.002s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-67100172-22c3-442c-a6ee-eedc2e7a3133 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-109547c8-7a26-4770-836c-506ab08caf48 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-87c3fd1c-e74d-4561-a11e-d580034cf0cf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:42 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-67100172-22c3-442c-a6ee-eedc2e7a3133 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Deleted volume successfully. Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-67100172-22c3-442c-a6ee-eedc2e7a3133 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-c8b939e7-d830-4f2e-831c-e4f4151001fb-delete_volume" released by "delete_volume" :: held 3.506s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-109547c8-7a26-4770-836c-506ab08caf48 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "cinder-quobyte-87c3fd1c-e74d-4561-a11e-d580034cf0cf" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:42 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-7f87a0e3-e1fe-4b1b-bb58-68c8d214ffc4 req-89450247-00e4-492d-98ce-a22b18ab1f6e tempest-TestInstancesWithCinderVolumes-1817148846 None] attachment_update completed successfully. Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-109547c8-7a26-4770-836c-506ab08caf48 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-quobyte-87c3fd1c-e74d-4561-a11e-d580034cf0cf" acquired by "delete_volume" :: waited 0.027s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c7b9a7-94a0-4e5e-9930-e7bf46e31d05]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-109547c8-7a26-4770-836c-506ab08caf48 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-87c3fd1c-e74d-4561-a11e-d580034cf0cf {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:42 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-87c3fd1c-e74d-4561-a11e-d580034cf0cf Jul 07 17:34:42 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:43 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-91e8a63b-79c4-4f60-81a1-9353333eb17d 1073741824" returned: 0 in 1.167s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:43 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:UPDATE=136,cinder:SELECT=109,cinder:INSERT=34,cinder:DELETE=12 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:34:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-91e8a63b-79c4-4f60-81a1-9353333eb17d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:43 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:43 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-91e8a63b-79c4-4f60-81a1-9353333eb17d Jul 07 17:34:43 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-109547c8-7a26-4770-836c-506ab08caf48 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-87c3fd1c-e74d-4561-a11e-d580034cf0cf" returned: 0 in 1.042s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-109547c8-7a26-4770-836c-506ab08caf48 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-87c3fd1c-e74d-4561-a11e-d580034cf0cf {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:43 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-87c3fd1c-e74d-4561-a11e-d580034cf0cf Jul 07 17:34:43 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:44 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-91e8a63b-79c4-4f60-81a1-9353333eb17d" returned: 0 in 0.809s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.050s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5799ab54-15ed-458b-a271-49d92b40552c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91e8a63b-79c4-4f60-81a1-9353333eb17d', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e24af0-aafc-41f4-bffa-0ff697314586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:44 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Volume volume-91e8a63b-79c4-4f60-81a1-9353333eb17d (91e8a63b-79c4-4f60-81a1-9353333eb17d): created successfully Jul 07 17:34:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e24af0-aafc-41f4-bffa-0ff697314586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Flow 'volume_create_manager' (61e012bd-854f-4416-8f4f-d1b563c78d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:44 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-109547c8-7a26-4770-836c-506ab08caf48 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-87c3fd1c-e74d-4561-a11e-d580034cf0cf" returned: 0 in 0.803s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:44 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-109547c8-7a26-4770-836c-506ab08caf48 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-quobyte-87c3fd1c-e74d-4561-a11e-d580034cf0cf" released by "delete_volume" :: held 1.907s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:44 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-cdf91e8d-184c-4774-a461-fc92dd628e3b tempest-VolumesListTestJSON-2012880951 None] Created volume successfully. Jul 07 17:34:44 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-109547c8-7a26-4770-836c-506ab08caf48 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Created reservations ['b41d3c91-da51-48a8-b0d5-5102ac846af9', 'baf78275-98ab-4988-8250-50e27b902e78', 'fdc4f6b7-43a1-487b-9956-173ca0614fb0', '010543d8-b4e6-48e6-b827-a04ee972a041'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-109547c8-7a26-4770-836c-506ab08caf48 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-109547c8-7a26-4770-836c-506ab08caf48 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-109547c8-7a26-4770-836c-506ab08caf48 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-109547c8-7a26-4770-836c-506ab08caf48 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-109547c8-7a26-4770-836c-506ab08caf48 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-109547c8-7a26-4770-836c-506ab08caf48 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:44 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:34:44 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:45 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ed062e9a-2a77-4d91-8ff1-0b20c402870d tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "cinder-76338c3a-f76f-45ad-a48b-ecbe4ff19bc2-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:45 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ed062e9a-2a77-4d91-8ff1-0b20c402870d tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-76338c3a-f76f-45ad-a48b-ecbe4ff19bc2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:45 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ed062e9a-2a77-4d91-8ff1-0b20c402870d tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "cinder-quobyte-76338c3a-f76f-45ad-a48b-ecbe4ff19bc2" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:45 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ed062e9a-2a77-4d91-8ff1-0b20c402870d tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-quobyte-76338c3a-f76f-45ad-a48b-ecbe4ff19bc2" acquired by "delete_volume" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:45 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5fbd29-efdf-47ef-b733-8a40b27f993f]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ed062e9a-2a77-4d91-8ff1-0b20c402870d tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-76338c3a-f76f-45ad-a48b-ecbe4ff19bc2 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:45 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-76338c3a-f76f-45ad-a48b-ecbe4ff19bc2 Jul 07 17:34:45 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:45 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-109547c8-7a26-4770-836c-506ab08caf48 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.885s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:45 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-109547c8-7a26-4770-836c-506ab08caf48 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:45 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-109547c8-7a26-4770-836c-506ab08caf48 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Deleted volume successfully. Jul 07 17:34:45 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-109547c8-7a26-4770-836c-506ab08caf48 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-87c3fd1c-e74d-4561-a11e-d580034cf0cf-delete_volume" released by "delete_volume" :: held 3.167s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:46 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ed062e9a-2a77-4d91-8ff1-0b20c402870d tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-76338c3a-f76f-45ad-a48b-ecbe4ff19bc2" returned: 0 in 1.006s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ed062e9a-2a77-4d91-8ff1-0b20c402870d tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-76338c3a-f76f-45ad-a48b-ecbe4ff19bc2 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:46 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-76338c3a-f76f-45ad-a48b-ecbe4ff19bc2 Jul 07 17:34:46 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Flow 'volume_create_manager' (a12845a0-5d88-45c3-a7ec-304e0929af65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7852a88-3db4-47bc-82e3-632fb817a132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7852a88-3db4-47bc-82e3-632fb817a132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1195811554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06640524-5d3b-40c8-8bca-36eb3212349c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7dd0196c724342fba9d45a65f3e4a3a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:46Z,use_quota=True,user_id='ba64094d4b024ba88dff6f7001440f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79a7efe-8c24-4ad8-b312-3a53893814b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79a7efe-8c24-4ad8-b312-3a53893814b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf97b4b-2467-467c-a51f-6e5e0c587bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf97b4b-2467-467c-a51f-6e5e0c587bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06640524-5d3b-40c8-8bca-36eb3212349c', 'volume_name': 'volume-06640524-5d3b-40c8-8bca-36eb3212349c', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740f0128-4974-4a24-8c4c-3950bdc6655d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740f0128-4974-4a24-8c4c-3950bdc6655d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77835bce-2697-4a9e-8c87-691cedd50cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:46 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Volume 06640524-5d3b-40c8-8bca-36eb3212349c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06640524-5d3b-40c8-8bca-36eb3212349c', 'volume_size': 1} Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1195811554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06640524-5d3b-40c8-8bca-36eb3212349c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7dd0196c724342fba9d45a65f3e4a3a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:34:46Z,use_quota=True,user_id='ba64094d4b024ba88dff6f7001440f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Creating volume 06640524-5d3b-40c8-8bca-36eb3212349c {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:34:46 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:34:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-06640524-5d3b-40c8-8bca-36eb3212349c 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:46 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-06640524-5d3b-40c8-8bca-36eb3212349c 1073741824 Jul 07 17:34:46 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:47 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ed062e9a-2a77-4d91-8ff1-0b20c402870d tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-76338c3a-f76f-45ad-a48b-ecbe4ff19bc2" returned: 0 in 1.156s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:47 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ed062e9a-2a77-4d91-8ff1-0b20c402870d tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-quobyte-76338c3a-f76f-45ad-a48b-ecbe4ff19bc2" released by "delete_volume" :: held 2.245s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:47 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-ed062e9a-2a77-4d91-8ff1-0b20c402870d tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Created reservations ['4575d3f8-711f-440c-ab1e-fca4d17f458e', 'a8ef5002-7ac9-4a72-a033-380454fee50a', '6323e955-e0c9-4f20-bed8-6de313b3c1c7', 'a7a60d70-b591-471d-98b0-5482dca3cb21'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ed062e9a-2a77-4d91-8ff1-0b20c402870d tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ed062e9a-2a77-4d91-8ff1-0b20c402870d tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ed062e9a-2a77-4d91-8ff1-0b20c402870d tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ed062e9a-2a77-4d91-8ff1-0b20c402870d tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ed062e9a-2a77-4d91-8ff1-0b20c402870d tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ed062e9a-2a77-4d91-8ff1-0b20c402870d tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:47 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:34:47 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:47 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-06640524-5d3b-40c8-8bca-36eb3212349c 1073741824" returned: 0 in 1.285s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-06640524-5d3b-40c8-8bca-36eb3212349c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:47 devstack sudo[102226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-06640524-5d3b-40c8-8bca-36eb3212349c Jul 07 17:34:47 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:48 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ed062e9a-2a77-4d91-8ff1-0b20c402870d tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.831s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:48 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-ed062e9a-2a77-4d91-8ff1-0b20c402870d tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:48 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-ed062e9a-2a77-4d91-8ff1-0b20c402870d tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Deleted volume successfully. Jul 07 17:34:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ed062e9a-2a77-4d91-8ff1-0b20c402870d tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-76338c3a-f76f-45ad-a48b-ecbe4ff19bc2-delete_volume" released by "delete_volume" :: held 3.397s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a6c23e54-34a4-4334-9953-c58157eee57c tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "cinder-c0dff92e-567a-445c-8dc6-f0609ff14323-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a6c23e54-34a4-4334-9953-c58157eee57c tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-c0dff92e-567a-445c-8dc6-f0609ff14323-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a6c23e54-34a4-4334-9953-c58157eee57c tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "cinder-quobyte-c0dff92e-567a-445c-8dc6-f0609ff14323" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a6c23e54-34a4-4334-9953-c58157eee57c tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-quobyte-c0dff92e-567a-445c-8dc6-f0609ff14323" acquired by "delete_volume" :: waited 0.026s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:48 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb136bc-ab6d-48b6-b55f-eaffe0276635]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a6c23e54-34a4-4334-9953-c58157eee57c tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c0dff92e-567a-445c-8dc6-f0609ff14323 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:48 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-06640524-5d3b-40c8-8bca-36eb3212349c" returned: 0 in 0.857s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] <== create_volume: return (2201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:34:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.204s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:48 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c0dff92e-567a-445c-8dc6-f0609ff14323 Jul 07 17:34:48 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77835bce-2697-4a9e-8c87-691cedd50cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06640524-5d3b-40c8-8bca-36eb3212349c', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7cbc6c-9bd1-42cf-bfb7-24ff26d2ddf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:34:48 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Volume volume-06640524-5d3b-40c8-8bca-36eb3212349c (06640524-5d3b-40c8-8bca-36eb3212349c): created successfully Jul 07 17:34:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7cbc6c-9bd1-42cf-bfb7-24ff26d2ddf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:34:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Flow 'volume_create_manager' (a12845a0-5d88-45c3-a7ec-304e0929af65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:34:48 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-6a0b78d6-369d-4057-a843-1ab384e59000 tempest-VolumesListTestJSON-2012880951 None] Created volume successfully. Jul 07 17:34:49 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a6c23e54-34a4-4334-9953-c58157eee57c tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c0dff92e-567a-445c-8dc6-f0609ff14323" returned: 0 in 0.955s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a6c23e54-34a4-4334-9953-c58157eee57c tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c0dff92e-567a-445c-8dc6-f0609ff14323 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:49 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c0dff92e-567a-445c-8dc6-f0609ff14323 Jul 07 17:34:49 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:50 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a6c23e54-34a4-4334-9953-c58157eee57c tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c0dff92e-567a-445c-8dc6-f0609ff14323" returned: 0 in 0.967s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:50 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a6c23e54-34a4-4334-9953-c58157eee57c tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-quobyte-c0dff92e-567a-445c-8dc6-f0609ff14323" released by "delete_volume" :: held 1.990s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:50 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-a6c23e54-34a4-4334-9953-c58157eee57c tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Created reservations ['d4ac3098-b0b9-4a47-b1e9-4f09187451d6', 'f8c4f62a-49d6-4861-879c-d56bbf67e489', '72dee760-d28b-45b2-b9ab-1da972fcdc41', '5cfdbb94-fbc7-4583-bc88-2e9c1a92da83'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a6c23e54-34a4-4334-9953-c58157eee57c tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a6c23e54-34a4-4334-9953-c58157eee57c tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a6c23e54-34a4-4334-9953-c58157eee57c tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a6c23e54-34a4-4334-9953-c58157eee57c tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a6c23e54-34a4-4334-9953-c58157eee57c tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a6c23e54-34a4-4334-9953-c58157eee57c tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:51 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:34:51 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dd4cb05d-c385-4d66-a8b9-1c6812a33e69 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "cinder-e9713cff-76eb-45bc-b904-1ebd217f0dfc-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dd4cb05d-c385-4d66-a8b9-1c6812a33e69 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-e9713cff-76eb-45bc-b904-1ebd217f0dfc-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dd4cb05d-c385-4d66-a8b9-1c6812a33e69 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "cinder-quobyte-e9713cff-76eb-45bc-b904-1ebd217f0dfc" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dd4cb05d-c385-4d66-a8b9-1c6812a33e69 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-quobyte-e9713cff-76eb-45bc-b904-1ebd217f0dfc" acquired by "delete_volume" :: waited 0.054s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:51 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bc63fc-469d-4d8c-a232-6b488993943a]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dd4cb05d-c385-4d66-a8b9-1c6812a33e69 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e9713cff-76eb-45bc-b904-1ebd217f0dfc {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:51 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e9713cff-76eb-45bc-b904-1ebd217f0dfc Jul 07 17:34:51 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:52 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a6c23e54-34a4-4334-9953-c58157eee57c tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.454s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:52 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-a6c23e54-34a4-4334-9953-c58157eee57c tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:52 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-a6c23e54-34a4-4334-9953-c58157eee57c tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Deleted volume successfully. Jul 07 17:34:52 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a6c23e54-34a4-4334-9953-c58157eee57c tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-c0dff92e-567a-445c-8dc6-f0609ff14323-delete_volume" released by "delete_volume" :: held 3.924s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:52 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dd4cb05d-c385-4d66-a8b9-1c6812a33e69 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e9713cff-76eb-45bc-b904-1ebd217f0dfc" returned: 0 in 1.536s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dd4cb05d-c385-4d66-a8b9-1c6812a33e69 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e9713cff-76eb-45bc-b904-1ebd217f0dfc {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:52 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e9713cff-76eb-45bc-b904-1ebd217f0dfc Jul 07 17:34:52 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c0639584-49a3-470b-a630-697b10a79a94 tempest-VolumesListTestJSON-2012880951 None] Acquiring lock "cinder-06640524-5d3b-40c8-8bca-36eb3212349c-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c0639584-49a3-470b-a630-697b10a79a94 tempest-VolumesListTestJSON-2012880951 None] Lock "cinder-06640524-5d3b-40c8-8bca-36eb3212349c-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c0639584-49a3-470b-a630-697b10a79a94 tempest-VolumesListTestJSON-2012880951 None] Acquiring lock "cinder-quobyte-06640524-5d3b-40c8-8bca-36eb3212349c" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c0639584-49a3-470b-a630-697b10a79a94 tempest-VolumesListTestJSON-2012880951 None] Lock "cinder-quobyte-06640524-5d3b-40c8-8bca-36eb3212349c" acquired by "delete_volume" :: waited 0.044s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:53 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[596d69a3-b2fc-4165-b8a9-6e3ea9b959b1]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c0639584-49a3-470b-a630-697b10a79a94 tempest-VolumesListTestJSON-2012880951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-06640524-5d3b-40c8-8bca-36eb3212349c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:53 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-06640524-5d3b-40c8-8bca-36eb3212349c Jul 07 17:34:53 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:53 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dd4cb05d-c385-4d66-a8b9-1c6812a33e69 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e9713cff-76eb-45bc-b904-1ebd217f0dfc" returned: 0 in 1.011s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dd4cb05d-c385-4d66-a8b9-1c6812a33e69 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-quobyte-e9713cff-76eb-45bc-b904-1ebd217f0dfc" released by "delete_volume" :: held 2.608s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:54 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-dd4cb05d-c385-4d66-a8b9-1c6812a33e69 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Created reservations ['eb74fb62-67de-4f7a-8ea1-35817da6d7bd', 'd3f8bfd0-36e4-411f-ba39-86931faf1f7a', '966c75a8-d3a9-421f-8a48-817b40261b16', 'f76df0d6-be35-4a2c-9d8b-da5c1a2b66ea'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dd4cb05d-c385-4d66-a8b9-1c6812a33e69 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dd4cb05d-c385-4d66-a8b9-1c6812a33e69 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:54 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dd4cb05d-c385-4d66-a8b9-1c6812a33e69 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:54 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dd4cb05d-c385-4d66-a8b9-1c6812a33e69 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dd4cb05d-c385-4d66-a8b9-1c6812a33e69 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dd4cb05d-c385-4d66-a8b9-1c6812a33e69 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:54 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:34:54 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:54 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bd2a62fd-6a92-4701-aa50-5f148130d205 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "cinder-6551f3ee-3105-4da1-9c9d-e7ff23287bbc-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:54 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bd2a62fd-6a92-4701-aa50-5f148130d205 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-6551f3ee-3105-4da1-9c9d-e7ff23287bbc-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:54 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bd2a62fd-6a92-4701-aa50-5f148130d205 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "cinder-quobyte-6551f3ee-3105-4da1-9c9d-e7ff23287bbc" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:54 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bd2a62fd-6a92-4701-aa50-5f148130d205 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-quobyte-6551f3ee-3105-4da1-9c9d-e7ff23287bbc" acquired by "delete_volume" :: waited 0.038s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:54 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf19d27c-645f-42d4-bfc3-63632c1acd20]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bd2a62fd-6a92-4701-aa50-5f148130d205 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6551f3ee-3105-4da1-9c9d-e7ff23287bbc {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:54 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c0639584-49a3-470b-a630-697b10a79a94 tempest-VolumesListTestJSON-2012880951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-06640524-5d3b-40c8-8bca-36eb3212349c" returned: 0 in 1.732s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c0639584-49a3-470b-a630-697b10a79a94 tempest-VolumesListTestJSON-2012880951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-06640524-5d3b-40c8-8bca-36eb3212349c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:55 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-06640524-5d3b-40c8-8bca-36eb3212349c Jul 07 17:34:55 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:55 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6551f3ee-3105-4da1-9c9d-e7ff23287bbc Jul 07 17:34:55 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:55 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dd4cb05d-c385-4d66-a8b9-1c6812a33e69 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.608s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:55 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-dd4cb05d-c385-4d66-a8b9-1c6812a33e69 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:55 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-dd4cb05d-c385-4d66-a8b9-1c6812a33e69 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Deleted volume successfully. Jul 07 17:34:55 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dd4cb05d-c385-4d66-a8b9-1c6812a33e69 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-e9713cff-76eb-45bc-b904-1ebd217f0dfc-delete_volume" released by "delete_volume" :: held 4.722s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:56 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bd2a62fd-6a92-4701-aa50-5f148130d205 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6551f3ee-3105-4da1-9c9d-e7ff23287bbc" returned: 0 in 1.443s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bd2a62fd-6a92-4701-aa50-5f148130d205 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6551f3ee-3105-4da1-9c9d-e7ff23287bbc {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:56 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6551f3ee-3105-4da1-9c9d-e7ff23287bbc Jul 07 17:34:56 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:56 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c0639584-49a3-470b-a630-697b10a79a94 tempest-VolumesListTestJSON-2012880951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-06640524-5d3b-40c8-8bca-36eb3212349c" returned: 0 in 1.653s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:34:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c0639584-49a3-470b-a630-697b10a79a94 tempest-VolumesListTestJSON-2012880951 None] Lock "cinder-quobyte-06640524-5d3b-40c8-8bca-36eb3212349c" released by "delete_volume" :: held 3.531s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:56 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:34:56 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:56 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-c0639584-49a3-470b-a630-697b10a79a94 tempest-VolumesListTestJSON-2012880951 None] Created reservations ['286cc305-59d7-48ac-9abd-0f00e40b9abb', '9de43d41-a096-4aea-a825-6e72b0fc52e4', '8115afe6-3598-438f-8f6f-5141c1468f2f', '9edbdb86-2913-4cbb-93d7-0c379fa7b2b7'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c0639584-49a3-470b-a630-697b10a79a94 tempest-VolumesListTestJSON-2012880951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c0639584-49a3-470b-a630-697b10a79a94 tempest-VolumesListTestJSON-2012880951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c0639584-49a3-470b-a630-697b10a79a94 tempest-VolumesListTestJSON-2012880951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c0639584-49a3-470b-a630-697b10a79a94 tempest-VolumesListTestJSON-2012880951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c0639584-49a3-470b-a630-697b10a79a94 tempest-VolumesListTestJSON-2012880951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c0639584-49a3-470b-a630-697b10a79a94 tempest-VolumesListTestJSON-2012880951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:57 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:34:57 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:57 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bd2a62fd-6a92-4701-aa50-5f148130d205 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6551f3ee-3105-4da1-9c9d-e7ff23287bbc" returned: 0 in 1.332s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bd2a62fd-6a92-4701-aa50-5f148130d205 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-quobyte-6551f3ee-3105-4da1-9c9d-e7ff23287bbc" released by "delete_volume" :: held 2.931s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:58 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-bd2a62fd-6a92-4701-aa50-5f148130d205 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Created reservations ['36efed0b-13ca-4481-807a-1de616786093', 'cad77691-f5ba-4d05-b2b3-3aac054a7b61', '718113f3-efa7-4052-8194-b6afb43b7f1a', '81cb482f-850a-47be-b260-e2faa1ff3bc3'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:34:58 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5dd8f2af-4c7c-4f90-8660-96245df8587c tempest-VolumesListTestJSON-2012880951 None] Acquiring lock "cinder-91e8a63b-79c4-4f60-81a1-9353333eb17d-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:58 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5dd8f2af-4c7c-4f90-8660-96245df8587c tempest-VolumesListTestJSON-2012880951 None] Lock "cinder-91e8a63b-79c4-4f60-81a1-9353333eb17d-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bd2a62fd-6a92-4701-aa50-5f148130d205 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:34:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bd2a62fd-6a92-4701-aa50-5f148130d205 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:34:58 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-bd2a62fd-6a92-4701-aa50-5f148130d205 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:34:58 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-bd2a62fd-6a92-4701-aa50-5f148130d205 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:34:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bd2a62fd-6a92-4701-aa50-5f148130d205 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:34:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bd2a62fd-6a92-4701-aa50-5f148130d205 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:58 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5dd8f2af-4c7c-4f90-8660-96245df8587c tempest-VolumesListTestJSON-2012880951 None] Acquiring lock "cinder-quobyte-91e8a63b-79c4-4f60-81a1-9353333eb17d" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:34:58 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:34:58 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:58 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5dd8f2af-4c7c-4f90-8660-96245df8587c tempest-VolumesListTestJSON-2012880951 None] Lock "cinder-quobyte-91e8a63b-79c4-4f60-81a1-9353333eb17d" acquired by "delete_volume" :: waited 0.043s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:34:58 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4ecdf3-a08a-48f0-a610-549588d4534d]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:34:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5dd8f2af-4c7c-4f90-8660-96245df8587c tempest-VolumesListTestJSON-2012880951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-91e8a63b-79c4-4f60-81a1-9353333eb17d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:34:58 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.964s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:58 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:58 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:34:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:34:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:34:58 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-91e8a63b-79c4-4f60-81a1-9353333eb17d Jul 07 17:34:58 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:34:59 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c0639584-49a3-470b-a630-697b10a79a94 tempest-VolumesListTestJSON-2012880951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 2.083s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:59 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-c0639584-49a3-470b-a630-697b10a79a94 tempest-VolumesListTestJSON-2012880951 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:59 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-c0639584-49a3-470b-a630-697b10a79a94 tempest-VolumesListTestJSON-2012880951 None] Deleted volume successfully. Jul 07 17:34:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c0639584-49a3-470b-a630-697b10a79a94 tempest-VolumesListTestJSON-2012880951 None] Lock "cinder-06640524-5d3b-40c8-8bca-36eb3212349c-delete_volume" released by "delete_volume" :: held 6.253s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:34:59 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bd2a62fd-6a92-4701-aa50-5f148130d205 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.600s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:59 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-bd2a62fd-6a92-4701-aa50-5f148130d205 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:34:59 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Jul 07 17:34:59 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-bd2a62fd-6a92-4701-aa50-5f148130d205 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Deleted volume successfully. Jul 07 17:34:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5dd8f2af-4c7c-4f90-8660-96245df8587c tempest-VolumesListTestJSON-2012880951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-91e8a63b-79c4-4f60-81a1-9353333eb17d" returned: 0 in 1.478s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:34:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5dd8f2af-4c7c-4f90-8660-96245df8587c tempest-VolumesListTestJSON-2012880951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-91e8a63b-79c4-4f60-81a1-9353333eb17d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:00 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-91e8a63b-79c4-4f60-81a1-9353333eb17d Jul 07 17:35:00 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:00 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bd2a62fd-6a92-4701-aa50-5f148130d205 tempest-CreateVolumesFromSourceVolumeTest-1709634667 None] Lock "cinder-6551f3ee-3105-4da1-9c9d-e7ff23287bbc-delete_volume" released by "delete_volume" :: held 5.379s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:00 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5dd8f2af-4c7c-4f90-8660-96245df8587c tempest-VolumesListTestJSON-2012880951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-91e8a63b-79c4-4f60-81a1-9353333eb17d" returned: 0 in 0.966s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:00 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5dd8f2af-4c7c-4f90-8660-96245df8587c tempest-VolumesListTestJSON-2012880951 None] Lock "cinder-quobyte-91e8a63b-79c4-4f60-81a1-9353333eb17d" released by "delete_volume" :: held 2.521s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:01 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-5dd8f2af-4c7c-4f90-8660-96245df8587c tempest-VolumesListTestJSON-2012880951 None] Created reservations ['d2ec7ee9-621b-4220-a17b-d663ffbd4786', '54969759-7c23-4e0d-9162-768a1a4a8963', '2e993d72-3cb4-4284-9d9a-0f54cba5849b', '67e979cd-e393-4fcd-b438-bfd5ed6892a5'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:35:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5dd8f2af-4c7c-4f90-8660-96245df8587c tempest-VolumesListTestJSON-2012880951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5dd8f2af-4c7c-4f90-8660-96245df8587c tempest-VolumesListTestJSON-2012880951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5dd8f2af-4c7c-4f90-8660-96245df8587c tempest-VolumesListTestJSON-2012880951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5dd8f2af-4c7c-4f90-8660-96245df8587c tempest-VolumesListTestJSON-2012880951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5dd8f2af-4c7c-4f90-8660-96245df8587c tempest-VolumesListTestJSON-2012880951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5dd8f2af-4c7c-4f90-8660-96245df8587c tempest-VolumesListTestJSON-2012880951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:01 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:35:01 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-02ca4252-65d1-432c-9ede-e52972cb6e35 tempest-VolumesListTestJSON-2012880951 None] Acquiring lock "cinder-ced0f2de-2065-4d27-8cdf-c30c3cfd2876-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-02ca4252-65d1-432c-9ede-e52972cb6e35 tempest-VolumesListTestJSON-2012880951 None] Lock "cinder-ced0f2de-2065-4d27-8cdf-c30c3cfd2876-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-02ca4252-65d1-432c-9ede-e52972cb6e35 tempest-VolumesListTestJSON-2012880951 None] Acquiring lock "cinder-quobyte-ced0f2de-2065-4d27-8cdf-c30c3cfd2876" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-02ca4252-65d1-432c-9ede-e52972cb6e35 tempest-VolumesListTestJSON-2012880951 None] Lock "cinder-quobyte-ced0f2de-2065-4d27-8cdf-c30c3cfd2876" acquired by "delete_volume" :: waited 0.013s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:02 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e955cd-c876-4549-88b0-3d347dda2b88]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-02ca4252-65d1-432c-9ede-e52972cb6e35 tempest-VolumesListTestJSON-2012880951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ced0f2de-2065-4d27-8cdf-c30c3cfd2876 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:02 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ced0f2de-2065-4d27-8cdf-c30c3cfd2876 Jul 07 17:35:02 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:02 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5dd8f2af-4c7c-4f90-8660-96245df8587c tempest-VolumesListTestJSON-2012880951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.572s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:02 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-5dd8f2af-4c7c-4f90-8660-96245df8587c tempest-VolumesListTestJSON-2012880951 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:35:02 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5dd8f2af-4c7c-4f90-8660-96245df8587c tempest-VolumesListTestJSON-2012880951 None] Deleted volume successfully. Jul 07 17:35:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5dd8f2af-4c7c-4f90-8660-96245df8587c tempest-VolumesListTestJSON-2012880951 None] Lock "cinder-91e8a63b-79c4-4f60-81a1-9353333eb17d-delete_volume" released by "delete_volume" :: held 4.652s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:03 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-02ca4252-65d1-432c-9ede-e52972cb6e35 tempest-VolumesListTestJSON-2012880951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ced0f2de-2065-4d27-8cdf-c30c3cfd2876" returned: 0 in 1.489s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-02ca4252-65d1-432c-9ede-e52972cb6e35 tempest-VolumesListTestJSON-2012880951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ced0f2de-2065-4d27-8cdf-c30c3cfd2876 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:03 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ced0f2de-2065-4d27-8cdf-c30c3cfd2876 Jul 07 17:35:03 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:04 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-02ca4252-65d1-432c-9ede-e52972cb6e35 tempest-VolumesListTestJSON-2012880951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ced0f2de-2065-4d27-8cdf-c30c3cfd2876" returned: 0 in 0.998s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:04 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-02ca4252-65d1-432c-9ede-e52972cb6e35 tempest-VolumesListTestJSON-2012880951 None] Lock "cinder-quobyte-ced0f2de-2065-4d27-8cdf-c30c3cfd2876" released by "delete_volume" :: held 2.585s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:04 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-02ca4252-65d1-432c-9ede-e52972cb6e35 tempest-VolumesListTestJSON-2012880951 None] Created reservations ['78cb646a-6e4a-4da5-8242-1bf637a38ed1', '69084d04-c246-400e-80bc-9ca599e3802e', '6a14262a-cea6-4f38-a47e-7a02e9060cbf', '8866d6e2-96c8-4a96-a2a6-b5831d3a4567'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:35:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-02ca4252-65d1-432c-9ede-e52972cb6e35 tempest-VolumesListTestJSON-2012880951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-02ca4252-65d1-432c-9ede-e52972cb6e35 tempest-VolumesListTestJSON-2012880951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-02ca4252-65d1-432c-9ede-e52972cb6e35 tempest-VolumesListTestJSON-2012880951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-02ca4252-65d1-432c-9ede-e52972cb6e35 tempest-VolumesListTestJSON-2012880951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-02ca4252-65d1-432c-9ede-e52972cb6e35 tempest-VolumesListTestJSON-2012880951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-02ca4252-65d1-432c-9ede-e52972cb6e35 tempest-VolumesListTestJSON-2012880951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:04 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:35:04 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Flow 'volume_create_manager' (45fbc4fa-f28d-472b-8dc0-45929e6ae8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5780463c-9611-4efa-a905-7ecdce6c97e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5780463c-9611-4efa-a905-7ecdce6c97e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-250527772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43aa5854-c5c3-498a-8aa9-e823b35a1642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b8732f8d8e430fbf1a18f7e8772b23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:05Z,use_quota=True,user_id='d0af34a3b82647cbb6fd4f762c871379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86689960-a1c8-4f7f-8f4e-b3abeb4a17d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86689960-a1c8-4f7f-8f4e-b3abeb4a17d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d8d166-8fe4-416f-9e73-5b06168c710c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d8d166-8fe4-416f-9e73-5b06168c710c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43aa5854-c5c3-498a-8aa9-e823b35a1642', 'volume_name': 'volume-43aa5854-c5c3-498a-8aa9-e823b35a1642', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be31248-37f2-481d-b3f3-7f70f2891251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be31248-37f2-481d-b3f3-7f70f2891251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f87604c-18b1-4033-b1db-0dac1a076aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:05 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Volume 43aa5854-c5c3-498a-8aa9-e823b35a1642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43aa5854-c5c3-498a-8aa9-e823b35a1642', 'volume_size': 1} Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-250527772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43aa5854-c5c3-498a-8aa9-e823b35a1642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b8732f8d8e430fbf1a18f7e8772b23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:05Z,use_quota=True,user_id='d0af34a3b82647cbb6fd4f762c871379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Creating volume 43aa5854-c5c3-498a-8aa9-e823b35a1642 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:05 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:35:05 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-43aa5854-c5c3-498a-8aa9-e823b35a1642 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-02ca4252-65d1-432c-9ede-e52972cb6e35 tempest-VolumesListTestJSON-2012880951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.869s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-02ca4252-65d1-432c-9ede-e52972cb6e35 tempest-VolumesListTestJSON-2012880951 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:35:05 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-02ca4252-65d1-432c-9ede-e52972cb6e35 tempest-VolumesListTestJSON-2012880951 None] Deleted volume successfully. Jul 07 17:35:05 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-43aa5854-c5c3-498a-8aa9-e823b35a1642 1073741824 Jul 07 17:35:05 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:05 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-02ca4252-65d1-432c-9ede-e52972cb6e35 tempest-VolumesListTestJSON-2012880951 None] Lock "cinder-ced0f2de-2065-4d27-8cdf-c30c3cfd2876-delete_volume" released by "delete_volume" :: held 3.792s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:06 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-43aa5854-c5c3-498a-8aa9-e823b35a1642 1073741824" returned: 0 in 1.270s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-43aa5854-c5c3-498a-8aa9-e823b35a1642 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:06 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-43aa5854-c5c3-498a-8aa9-e823b35a1642 Jul 07 17:35:06 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:07 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-43aa5854-c5c3-498a-8aa9-e823b35a1642" returned: 0 in 0.972s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] <== create_volume: return (2312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:35:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.315s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f87604c-18b1-4033-b1db-0dac1a076aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43aa5854-c5c3-498a-8aa9-e823b35a1642', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ce8500-f931-4f99-9d04-aef85acdb222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:07 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Volume volume-43aa5854-c5c3-498a-8aa9-e823b35a1642 (43aa5854-c5c3-498a-8aa9-e823b35a1642): created successfully Jul 07 17:35:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ce8500-f931-4f99-9d04-aef85acdb222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Flow 'volume_create_manager' (45fbc4fa-f28d-472b-8dc0-45929e6ae8a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:08 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:UPDATE=165,cinder:SELECT=107,cinder:INSERT=37,cinder:DELETE=14 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:35:08 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-92bae24d-ab16-43e3-862c-2c439866eed0 tempest-ProjectReaderTests-1688457087 None] Created volume successfully. Jul 07 17:35:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c7597fdb-e660-427a-a0fe-a91f1c637405 tempest-ProjectReaderTests-1688457087 None] Acquiring lock "cinder-43aa5854-c5c3-498a-8aa9-e823b35a1642-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c7597fdb-e660-427a-a0fe-a91f1c637405 tempest-ProjectReaderTests-1688457087 None] Lock "cinder-43aa5854-c5c3-498a-8aa9-e823b35a1642-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c7597fdb-e660-427a-a0fe-a91f1c637405 tempest-ProjectReaderTests-1688457087 None] Acquiring lock "cinder-quobyte-43aa5854-c5c3-498a-8aa9-e823b35a1642" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c7597fdb-e660-427a-a0fe-a91f1c637405 tempest-ProjectReaderTests-1688457087 None] Lock "cinder-quobyte-43aa5854-c5c3-498a-8aa9-e823b35a1642" acquired by "delete_volume" :: waited 0.026s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:09 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[143abf14-b4c6-4403-8a22-9be51ed1afdd]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c7597fdb-e660-427a-a0fe-a91f1c637405 tempest-ProjectReaderTests-1688457087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-43aa5854-c5c3-498a-8aa9-e823b35a1642 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:09 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-43aa5854-c5c3-498a-8aa9-e823b35a1642 Jul 07 17:35:09 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:09 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c7597fdb-e660-427a-a0fe-a91f1c637405 tempest-ProjectReaderTests-1688457087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-43aa5854-c5c3-498a-8aa9-e823b35a1642" returned: 0 in 0.974s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c7597fdb-e660-427a-a0fe-a91f1c637405 tempest-ProjectReaderTests-1688457087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-43aa5854-c5c3-498a-8aa9-e823b35a1642 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:10 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-43aa5854-c5c3-498a-8aa9-e823b35a1642 Jul 07 17:35:10 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:10 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c7597fdb-e660-427a-a0fe-a91f1c637405 tempest-ProjectReaderTests-1688457087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-43aa5854-c5c3-498a-8aa9-e823b35a1642" returned: 0 in 0.852s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c7597fdb-e660-427a-a0fe-a91f1c637405 tempest-ProjectReaderTests-1688457087 None] Lock "cinder-quobyte-43aa5854-c5c3-498a-8aa9-e823b35a1642" released by "delete_volume" :: held 1.878s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:10 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-c7597fdb-e660-427a-a0fe-a91f1c637405 tempest-ProjectReaderTests-1688457087 None] Created reservations ['d1092caa-d7cf-4987-a4e2-a322b5904ef7', 'af849ac2-c9c4-454f-b740-fb1246435e04', '8a658c4c-b723-485d-9035-780be9c56b83', '0617f87d-fbc0-4995-a885-8fe77d4b0a3e'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:35:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c7597fdb-e660-427a-a0fe-a91f1c637405 tempest-ProjectReaderTests-1688457087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c7597fdb-e660-427a-a0fe-a91f1c637405 tempest-ProjectReaderTests-1688457087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c7597fdb-e660-427a-a0fe-a91f1c637405 tempest-ProjectReaderTests-1688457087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c7597fdb-e660-427a-a0fe-a91f1c637405 tempest-ProjectReaderTests-1688457087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c7597fdb-e660-427a-a0fe-a91f1c637405 tempest-ProjectReaderTests-1688457087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c7597fdb-e660-427a-a0fe-a91f1c637405 tempest-ProjectReaderTests-1688457087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:11 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:35:11 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:11 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c7597fdb-e660-427a-a0fe-a91f1c637405 tempest-ProjectReaderTests-1688457087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.859s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:11 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-c7597fdb-e660-427a-a0fe-a91f1c637405 tempest-ProjectReaderTests-1688457087 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:35:11 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:35:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Flow 'volume_create_manager' (0132c086-efcf-4945-8f1a-dd5d7ce8d632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac7456b-7f6b-48eb-a7f0-f28f9fb6ac64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:11 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-c7597fdb-e660-427a-a0fe-a91f1c637405 tempest-ProjectReaderTests-1688457087 None] Deleted volume successfully. Jul 07 17:35:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac7456b-7f6b-48eb-a7f0-f28f9fb6ac64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1337592701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d7b75d5-a0a0-4a9f-aeef-f75b262326ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b8732f8d8e430fbf1a18f7e8772b23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:12Z,use_quota=True,user_id='d0af34a3b82647cbb6fd4f762c871379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99663dc0-3666-4252-924a-bc314823dc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99663dc0-3666-4252-924a-bc314823dc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b60c158-8248-4bab-b62c-23cc5344dc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b60c158-8248-4bab-b62c-23cc5344dc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d7b75d5-a0a0-4a9f-aeef-f75b262326ae', 'volume_name': 'volume-9d7b75d5-a0a0-4a9f-aeef-f75b262326ae', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbcf7e25-6cfa-4b3f-bd27-a0a3544080bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbcf7e25-6cfa-4b3f-bd27-a0a3544080bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (495ad05f-55f5-4bd3-ac18-51a067134e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:12 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Volume 9d7b75d5-a0a0-4a9f-aeef-f75b262326ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d7b75d5-a0a0-4a9f-aeef-f75b262326ae', 'volume_size': 1} Jul 07 17:35:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1337592701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d7b75d5-a0a0-4a9f-aeef-f75b262326ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b8732f8d8e430fbf1a18f7e8772b23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:12Z,use_quota=True,user_id='d0af34a3b82647cbb6fd4f762c871379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:35:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Creating volume 9d7b75d5-a0a0-4a9f-aeef-f75b262326ae {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:35:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:35:12 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:35:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d7b75d5-a0a0-4a9f-aeef-f75b262326ae 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:12 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c7597fdb-e660-427a-a0fe-a91f1c637405 tempest-ProjectReaderTests-1688457087 None] Lock "cinder-43aa5854-c5c3-498a-8aa9-e823b35a1642-delete_volume" released by "delete_volume" :: held 3.138s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:12 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d7b75d5-a0a0-4a9f-aeef-f75b262326ae 1073741824 Jul 07 17:35:12 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:13 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d7b75d5-a0a0-4a9f-aeef-f75b262326ae 1073741824" returned: 0 in 1.099s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d7b75d5-a0a0-4a9f-aeef-f75b262326ae {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:13 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d7b75d5-a0a0-4a9f-aeef-f75b262326ae Jul 07 17:35:13 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:14 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d7b75d5-a0a0-4a9f-aeef-f75b262326ae" returned: 0 in 0.868s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] <== create_volume: return (2021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:35:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.025s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (495ad05f-55f5-4bd3-ac18-51a067134e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d7b75d5-a0a0-4a9f-aeef-f75b262326ae', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cc18f4-cd98-4322-a871-62fc9170c757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:14 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Volume volume-9d7b75d5-a0a0-4a9f-aeef-f75b262326ae (9d7b75d5-a0a0-4a9f-aeef-f75b262326ae): created successfully Jul 07 17:35:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cc18f4-cd98-4322-a871-62fc9170c757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Flow 'volume_create_manager' (0132c086-efcf-4945-8f1a-dd5d7ce8d632) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:14 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-06afa4d5-8df5-48fc-84bc-f712ab5868ae tempest-ProjectReaderTests-1688457087 None] Created volume successfully. Jul 07 17:35:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-66ef608c-f131-474a-a8fd-2a7c486e6a65 tempest-ProjectReaderTests-1688457087 None] Acquiring lock "cinder-9d7b75d5-a0a0-4a9f-aeef-f75b262326ae-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-66ef608c-f131-474a-a8fd-2a7c486e6a65 tempest-ProjectReaderTests-1688457087 None] Lock "cinder-9d7b75d5-a0a0-4a9f-aeef-f75b262326ae-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-66ef608c-f131-474a-a8fd-2a7c486e6a65 tempest-ProjectReaderTests-1688457087 None] Acquiring lock "cinder-quobyte-9d7b75d5-a0a0-4a9f-aeef-f75b262326ae" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-66ef608c-f131-474a-a8fd-2a7c486e6a65 tempest-ProjectReaderTests-1688457087 None] Lock "cinder-quobyte-9d7b75d5-a0a0-4a9f-aeef-f75b262326ae" acquired by "delete_volume" :: waited 0.028s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:15 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad7e687-fa68-43ce-9bec-7d640eceef8c]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-66ef608c-f131-474a-a8fd-2a7c486e6a65 tempest-ProjectReaderTests-1688457087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d7b75d5-a0a0-4a9f-aeef-f75b262326ae {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:15 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d7b75d5-a0a0-4a9f-aeef-f75b262326ae Jul 07 17:35:15 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:16 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-66ef608c-f131-474a-a8fd-2a7c486e6a65 tempest-ProjectReaderTests-1688457087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d7b75d5-a0a0-4a9f-aeef-f75b262326ae" returned: 0 in 1.279s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-66ef608c-f131-474a-a8fd-2a7c486e6a65 tempest-ProjectReaderTests-1688457087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d7b75d5-a0a0-4a9f-aeef-f75b262326ae {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:16 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d7b75d5-a0a0-4a9f-aeef-f75b262326ae Jul 07 17:35:16 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:17 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-66ef608c-f131-474a-a8fd-2a7c486e6a65 tempest-ProjectReaderTests-1688457087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9d7b75d5-a0a0-4a9f-aeef-f75b262326ae" returned: 0 in 1.053s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-66ef608c-f131-474a-a8fd-2a7c486e6a65 tempest-ProjectReaderTests-1688457087 None] Lock "cinder-quobyte-9d7b75d5-a0a0-4a9f-aeef-f75b262326ae" released by "delete_volume" :: held 2.404s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:17 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-66ef608c-f131-474a-a8fd-2a7c486e6a65 tempest-ProjectReaderTests-1688457087 None] Created reservations ['12f5a720-3eee-42ca-9b08-e209980772c4', '5ca01bc4-fdcd-4613-b988-d5f426a4841f', '8b75dbf9-3db1-4f2c-b78b-838ddafa0f05', 'd1a6084c-2522-46ad-bb62-85c04e260ba1'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:35:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-66ef608c-f131-474a-a8fd-2a7c486e6a65 tempest-ProjectReaderTests-1688457087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-66ef608c-f131-474a-a8fd-2a7c486e6a65 tempest-ProjectReaderTests-1688457087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-66ef608c-f131-474a-a8fd-2a7c486e6a65 tempest-ProjectReaderTests-1688457087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-66ef608c-f131-474a-a8fd-2a7c486e6a65 tempest-ProjectReaderTests-1688457087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-66ef608c-f131-474a-a8fd-2a7c486e6a65 tempest-ProjectReaderTests-1688457087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-66ef608c-f131-474a-a8fd-2a7c486e6a65 tempest-ProjectReaderTests-1688457087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:17 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:35:17 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:18 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-66ef608c-f131-474a-a8fd-2a7c486e6a65 tempest-ProjectReaderTests-1688457087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.020s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:18 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-66ef608c-f131-474a-a8fd-2a7c486e6a65 tempest-ProjectReaderTests-1688457087 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:35:18 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-66ef608c-f131-474a-a8fd-2a7c486e6a65 tempest-ProjectReaderTests-1688457087 None] Deleted volume successfully. Jul 07 17:35:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-66ef608c-f131-474a-a8fd-2a7c486e6a65 tempest-ProjectReaderTests-1688457087 None] Lock "cinder-9d7b75d5-a0a0-4a9f-aeef-f75b262326ae-delete_volume" released by "delete_volume" :: held 3.819s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:21 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:35:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Flow 'volume_create_manager' (64222b94-5cab-47f5-b992-51efcbd4dda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a2567c-a0b5-4045-a595-0d9c6dbd1e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a2567c-a0b5-4045-a595-0d9c6dbd1e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1719951647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c09bf827-c7c4-4aca-96d6-e79ce0f380bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0410c3fd5f054f6da0cdf80bd52bf06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:21Z,use_quota=True,user_id='2c9d787c57c64da89f3a8b2631aa017a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2b025d-3b5a-4494-b08d-f4798505c6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2b025d-3b5a-4494-b08d-f4798505c6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (673ab891-d5ba-4ee0-9310-7befbb2003e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (673ab891-d5ba-4ee0-9310-7befbb2003e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c09bf827-c7c4-4aca-96d6-e79ce0f380bc', 'volume_name': 'volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7923e8d5-3bac-402d-9acc-466b80e34478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7923e8d5-3bac-402d-9acc-466b80e34478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:21 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d52a6f-f916-4283-b820-2d6ae3966f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:21 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Volume c09bf827-c7c4-4aca-96d6-e79ce0f380bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc', 'volume_size': 1} Jul 07 17:35:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1719951647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c09bf827-c7c4-4aca-96d6-e79ce0f380bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0410c3fd5f054f6da0cdf80bd52bf06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:21Z,use_quota=True,user_id='2c9d787c57c64da89f3a8b2631aa017a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:35:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Creating volume c09bf827-c7c4-4aca-96d6-e79ce0f380bc {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:35:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:35:21 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:35:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:21 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc 1073741824 Jul 07 17:35:21 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:22 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc 1073741824" returned: 0 in 1.001s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:22 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc Jul 07 17:35:22 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:23 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc" returned: 0 in 0.847s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:23 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:35:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.912s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d52a6f-f916-4283-b820-2d6ae3966f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24659a5e-156b-4f89-a683-532151082b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:23 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Volume volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc (c09bf827-c7c4-4aca-96d6-e79ce0f380bc): created successfully Jul 07 17:35:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24659a5e-156b-4f89-a683-532151082b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Flow 'volume_create_manager' (64222b94-5cab-47f5-b992-51efcbd4dda8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:23 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-cfffa7d9-efde-4998-bfaf-51b79c54a642 tempest-VolumesSnapshotTestJSON-1565575080 None] Created volume successfully. Jul 07 17:35:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3d994a6d-f550-474a-84a3-cfba4d6628a6 tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3d994a6d-f550-474a-84a3-cfba4d6628a6 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:24 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-3d994a6d-f550-474a-84a3-cfba4d6628a6 tempest-VolumesSnapshotTestJSON-1565575080 None] Creating offline snapshot 6bb06abc-6a59-4145-a320-6b46e82f0445 of volume c09bf827-c7c4-4aca-96d6-e79ce0f380bc {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:35:24 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[009cf39c-3aac-493f-83d7-85b56fa0eafe]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3d994a6d-f550-474a-84a3-cfba4d6628a6 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:24 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc Jul 07 17:35:24 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:25 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3d994a6d-f550-474a-84a3-cfba4d6628a6 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc" returned: 0 in 0.976s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3d994a6d-f550-474a-84a3-cfba4d6628a6 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.6bb06abc-6a59-4145-a320-6b46e82f0445 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:25 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.6bb06abc-6a59-4145-a320-6b46e82f0445 1G Jul 07 17:35:25 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-5c656c60-6e7f-429c-8eb7-81643fdabb3b req-29fd4f8a-c731-43b8-bc8c-286bacb79970 tempest-TestInstancesWithCinderVolumes-1817148846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:26 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3d994a6d-f550-474a-84a3-cfba4d6628a6 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.6bb06abc-6a59-4145-a320-6b46e82f0445 1G" returned: 0 in 1.182s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3d994a6d-f550-474a-84a3-cfba4d6628a6 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.6bb06abc-6a59-4145-a320-6b46e82f0445 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:26 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.6bb06abc-6a59-4145-a320-6b46e82f0445 Jul 07 17:35:26 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:27 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3d994a6d-f550-474a-84a3-cfba4d6628a6 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.6bb06abc-6a59-4145-a320-6b46e82f0445" returned: 0 in 0.805s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:27 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-3d994a6d-f550-474a-84a3-cfba4d6628a6 tempest-VolumesSnapshotTestJSON-1565575080 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.6bb06abc-6a59-4145-a320-6b46e82f0445 is being set with open permissions: ugo+rw Jul 07 17:35:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3d994a6d-f550-474a-84a3-cfba4d6628a6 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.6bb06abc-6a59-4145-a320-6b46e82f0445 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:27 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.6bb06abc-6a59-4145-a320-6b46e82f0445 Jul 07 17:35:27 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:28 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3d994a6d-f550-474a-84a3-cfba4d6628a6 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.6bb06abc-6a59-4145-a320-6b46e82f0445" returned: 0 in 0.709s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3d994a6d-f550-474a-84a3-cfba4d6628a6 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:28 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.info Jul 07 17:35:28 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:29 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3d994a6d-f550-474a-84a3-cfba4d6628a6 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.info" returned: 0 in 0.743s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:29 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-3d994a6d-f550-474a-84a3-cfba4d6628a6 tempest-VolumesSnapshotTestJSON-1565575080 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.info is being set with open permissions: ugo+rw Jul 07 17:35:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3d994a6d-f550-474a-84a3-cfba4d6628a6 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:29 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.info Jul 07 17:35:29 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:29 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3d994a6d-f550-474a-84a3-cfba4d6628a6 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.info" returned: 0 in 0.720s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3d994a6d-f550-474a-84a3-cfba4d6628a6 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.254s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-5c656c60-6e7f-429c-8eb7-81643fdabb3b req-29fd4f8a-c731-43b8-bc8c-286bacb79970 tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.108s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:29 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[b204fd1b-a6e6-4ea3-ada2-ad37dfacdd80]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-5c656c60-6e7f-429c-8eb7-81643fdabb3b req-29fd4f8a-c731-43b8-bc8c-286bacb79970 tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:30 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-3d994a6d-f550-474a-84a3-cfba4d6628a6 tempest-VolumesSnapshotTestJSON-1565575080 None] Create snapshot completed successfully Jul 07 17:35:30 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0 Jul 07 17:35:30 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:30 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-5c656c60-6e7f-429c-8eb7-81643fdabb3b req-29fd4f8a-c731-43b8-bc8c-286bacb79970 tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0" returned: 0 in 0.820s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-5c656c60-6e7f-429c-8eb7-81643fdabb3b req-29fd4f8a-c731-43b8-bc8c-286bacb79970 tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.845s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-5c656c60-6e7f-429c-8eb7-81643fdabb3b req-29fd4f8a-c731-43b8-bc8c-286bacb79970 tempest-TestInstancesWithCinderVolumes-1817148846 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2', 'name': 'volume-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '871ba857-6e26-4917-b1d0-11555b4cc2a1', 'enforce_multipath': True} {{(pid=87303) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:35:30 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-5c656c60-6e7f-429c-8eb7-81643fdabb3b req-29fd4f8a-c731-43b8-bc8c-286bacb79970 tempest-TestInstancesWithCinderVolumes-1817148846 None] attachment_update completed successfully. Jul 07 17:35:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-988f7722-b823-4b50-93a5-3571f9635cea tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "cinder-6bb06abc-6a59-4145-a320-6b46e82f0445-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-988f7722-b823-4b50-93a5-3571f9635cea tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-6bb06abc-6a59-4145-a320-6b46e82f0445-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-988f7722-b823-4b50-93a5-3571f9635cea tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "cinder-quobyte-c09bf827-c7c4-4aca-96d6-e79ce0f380bc" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-988f7722-b823-4b50-93a5-3571f9635cea tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-c09bf827-c7c4-4aca-96d6-e79ce0f380bc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-988f7722-b823-4b50-93a5-3571f9635cea tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "cinder-quobyte-6bb06abc-6a59-4145-a320-6b46e82f0445" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-988f7722-b823-4b50-93a5-3571f9635cea tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-6bb06abc-6a59-4145-a320-6b46e82f0445" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-988f7722-b823-4b50-93a5-3571f9635cea tempest-VolumesSnapshotTestJSON-1565575080 None] Deleting offline snapshot 6bb06abc-6a59-4145-a320-6b46e82f0445 of volume c09bf827-c7c4-4aca-96d6-e79ce0f380bc {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:35:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-988f7722-b823-4b50-93a5-3571f9635cea tempest-VolumesSnapshotTestJSON-1565575080 None] snapshot_file for this snap is: volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.6bb06abc-6a59-4145-a320-6b46e82f0445 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:35:31 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c7352a-f652-48ba-b180-472d93d9e864]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-988f7722-b823-4b50-93a5-3571f9635cea tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.6bb06abc-6a59-4145-a320-6b46e82f0445 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:31 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.6bb06abc-6a59-4145-a320-6b46e82f0445 Jul 07 17:35:31 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:32 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-988f7722-b823-4b50-93a5-3571f9635cea tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.6bb06abc-6a59-4145-a320-6b46e82f0445" returned: 0 in 0.867s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-988f7722-b823-4b50-93a5-3571f9635cea tempest-VolumesSnapshotTestJSON-1565575080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:35:32 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b85061-ab6e-4416-a609-0bccca5d54ed]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-988f7722-b823-4b50-93a5-3571f9635cea tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:32 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc Jul 07 17:35:32 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:33 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-988f7722-b823-4b50-93a5-3571f9635cea tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc" returned: 0 in 0.830s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-988f7722-b823-4b50-93a5-3571f9635cea tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.6bb06abc-6a59-4145-a320-6b46e82f0445 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:33 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.6bb06abc-6a59-4145-a320-6b46e82f0445 Jul 07 17:35:33 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:33 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-988f7722-b823-4b50-93a5-3571f9635cea tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.6bb06abc-6a59-4145-a320-6b46e82f0445" returned: 0 in 0.836s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-988f7722-b823-4b50-93a5-3571f9635cea tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.6bb06abc-6a59-4145-a320-6b46e82f0445 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:33 devstack sudo[102576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.6bb06abc-6a59-4145-a320-6b46e82f0445 Jul 07 17:35:33 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:34 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-988f7722-b823-4b50-93a5-3571f9635cea tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc.6bb06abc-6a59-4145-a320-6b46e82f0445" returned: 0 in 0.704s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-988f7722-b823-4b50-93a5-3571f9635cea tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-6bb06abc-6a59-4145-a320-6b46e82f0445" released by "_delete_snapshot" :: held 3.370s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-988f7722-b823-4b50-93a5-3571f9635cea tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-c09bf827-c7c4-4aca-96d6-e79ce0f380bc" released by "delete_snapshot" :: held 3.396s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:34 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-988f7722-b823-4b50-93a5-3571f9635cea tempest-VolumesSnapshotTestJSON-1565575080 None] Created reservations ['bd3c5f8d-28f9-4552-90ab-be5e38f8c5a4', '24dc5360-e166-4c3a-b214-3cc71f7f9a12', '5c7cf1ec-4b05-442f-a37e-cd14084848b8', '6564f332-b1a2-44e2-9b5f-7d5d53f0cac5'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:35:34 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-988f7722-b823-4b50-93a5-3571f9635cea tempest-VolumesSnapshotTestJSON-1565575080 None] Delete snapshot completed successfully. Jul 07 17:35:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-988f7722-b823-4b50-93a5-3571f9635cea tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-6bb06abc-6a59-4145-a320-6b46e82f0445-delete_snapshot" released by "delete_snapshot" :: held 3.614s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:36 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:35:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Flow 'volume_create_manager' (7a5202ec-f09b-4afa-8d35-e295d0cdaf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119d6839-f7b5-46b6-b36e-2198aeb18c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119d6839-f7b5-46b6-b36e-2198aeb18c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-512384344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645152da-5d4c-45d3-8a0f-4d807643b285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0410c3fd5f054f6da0cdf80bd52bf06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:36Z,use_quota=True,user_id='2c9d787c57c64da89f3a8b2631aa017a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b37d6ed2-da60-4af3-ad3d-b5abb4fd9ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b37d6ed2-da60-4af3-ad3d-b5abb4fd9ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0ac63e-06df-41dc-962a-9c10c3c792a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0ac63e-06df-41dc-962a-9c10c3c792a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '645152da-5d4c-45d3-8a0f-4d807643b285', 'volume_name': 'volume-645152da-5d4c-45d3-8a0f-4d807643b285', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71212295-1fe4-41b5-96c9-fa028264b072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71212295-1fe4-41b5-96c9-fa028264b072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178d8803-f727-4cc0-83d5-4ccd3a0c741f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:36 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Volume 645152da-5d4c-45d3-8a0f-4d807643b285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-645152da-5d4c-45d3-8a0f-4d807643b285', 'volume_size': 1} Jul 07 17:35:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-512384344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645152da-5d4c-45d3-8a0f-4d807643b285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0410c3fd5f054f6da0cdf80bd52bf06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:36Z,use_quota=True,user_id='2c9d787c57c64da89f3a8b2631aa017a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:35:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Creating volume 645152da-5d4c-45d3-8a0f-4d807643b285 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:35:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:35:36 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:35:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:36 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285 1073741824 Jul 07 17:35:36 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:37 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285 1073741824" returned: 0 in 0.940s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:37 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285 Jul 07 17:35:37 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:38 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285" returned: 0 in 0.778s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:35:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178d8803-f727-4cc0-83d5-4ccd3a0c741f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-645152da-5d4c-45d3-8a0f-4d807643b285', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (762864b0-dc0a-492b-9e78-4e13cd61ade9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:38 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Volume volume-645152da-5d4c-45d3-8a0f-4d807643b285 (645152da-5d4c-45d3-8a0f-4d807643b285): created successfully Jul 07 17:35:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (762864b0-dc0a-492b-9e78-4e13cd61ade9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Flow 'volume_create_manager' (7a5202ec-f09b-4afa-8d35-e295d0cdaf9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:38 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-aa020e7f-3f2c-4cb7-ac18-34ef7a4f6647 tempest-VolumesSnapshotTestJSON-1565575080 None] Created volume successfully. Jul 07 17:35:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-38c98772-eb91-4adc-b8c5-3adf491fda61 tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-38c98772-eb91-4adc-b8c5-3adf491fda61 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-38c98772-eb91-4adc-b8c5-3adf491fda61 tempest-VolumesSnapshotTestJSON-1565575080 None] Creating offline snapshot f2b2992c-e4d3-48e3-a390-006d62ad0b97 of volume 645152da-5d4c-45d3-8a0f-4d807643b285 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:35:38 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc169d48-e6ef-4125-afd3-9f0252504aee]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38c98772-eb91-4adc-b8c5-3adf491fda61 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:38 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285 Jul 07 17:35:38 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-6a60be05-a58c-4cdf-9254-6ee5aa0b55cd req-4f59d5c0-73e5-4219-aca1-ed95dde83471 tempest-TestInstancesWithCinderVolumes-1817148846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:39 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38c98772-eb91-4adc-b8c5-3adf491fda61 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285" returned: 0 in 0.899s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38c98772-eb91-4adc-b8c5-3adf491fda61 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.f2b2992c-e4d3-48e3-a390-006d62ad0b97 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:39 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.f2b2992c-e4d3-48e3-a390-006d62ad0b97 1G Jul 07 17:35:39 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:40 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38c98772-eb91-4adc-b8c5-3adf491fda61 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.f2b2992c-e4d3-48e3-a390-006d62ad0b97 1G" returned: 0 in 0.918s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38c98772-eb91-4adc-b8c5-3adf491fda61 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-645152da-5d4c-45d3-8a0f-4d807643b285 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.f2b2992c-e4d3-48e3-a390-006d62ad0b97 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:40 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-645152da-5d4c-45d3-8a0f-4d807643b285 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.f2b2992c-e4d3-48e3-a390-006d62ad0b97 Jul 07 17:35:40 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:41 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38c98772-eb91-4adc-b8c5-3adf491fda61 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-645152da-5d4c-45d3-8a0f-4d807643b285 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.f2b2992c-e4d3-48e3-a390-006d62ad0b97" returned: 0 in 0.763s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:41 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-38c98772-eb91-4adc-b8c5-3adf491fda61 tempest-VolumesSnapshotTestJSON-1565575080 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.f2b2992c-e4d3-48e3-a390-006d62ad0b97 is being set with open permissions: ugo+rw Jul 07 17:35:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38c98772-eb91-4adc-b8c5-3adf491fda61 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.f2b2992c-e4d3-48e3-a390-006d62ad0b97 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:41 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.f2b2992c-e4d3-48e3-a390-006d62ad0b97 Jul 07 17:35:41 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:41 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38c98772-eb91-4adc-b8c5-3adf491fda61 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.f2b2992c-e4d3-48e3-a390-006d62ad0b97" returned: 0 in 0.740s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38c98772-eb91-4adc-b8c5-3adf491fda61 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:42 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.info Jul 07 17:35:42 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:42 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38c98772-eb91-4adc-b8c5-3adf491fda61 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.info" returned: 0 in 0.739s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:42 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-38c98772-eb91-4adc-b8c5-3adf491fda61 tempest-VolumesSnapshotTestJSON-1565575080 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.info is being set with open permissions: ugo+rw Jul 07 17:35:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38c98772-eb91-4adc-b8c5-3adf491fda61 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:42 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.info Jul 07 17:35:42 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:43 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38c98772-eb91-4adc-b8c5-3adf491fda61 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.info" returned: 0 in 0.753s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-38c98772-eb91-4adc-b8c5-3adf491fda61 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.917s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-6a60be05-a58c-4cdf-9254-6ee5aa0b55cd req-4f59d5c0-73e5-4219-aca1-ed95dde83471 tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.628s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:43 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a1f080-a745-4a2b-b4a0-6573e8ae89c2]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-6a60be05-a58c-4cdf-9254-6ee5aa0b55cd req-4f59d5c0-73e5-4219-aca1-ed95dde83471 tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1e5b8461-58fb-439f-86a3-1c77a717616e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:43 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-38c98772-eb91-4adc-b8c5-3adf491fda61 tempest-VolumesSnapshotTestJSON-1565575080 None] Create snapshot completed successfully Jul 07 17:35:43 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1e5b8461-58fb-439f-86a3-1c77a717616e Jul 07 17:35:43 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:44 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-6a60be05-a58c-4cdf-9254-6ee5aa0b55cd req-4f59d5c0-73e5-4219-aca1-ed95dde83471 tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1e5b8461-58fb-439f-86a3-1c77a717616e" returned: 0 in 0.911s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-6a60be05-a58c-4cdf-9254-6ee5aa0b55cd req-4f59d5c0-73e5-4219-aca1-ed95dde83471 tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.951s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:UPDATE=107,cinder:SELECT=89,cinder:INSERT=25,cinder:DELETE=11 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-6a60be05-a58c-4cdf-9254-6ee5aa0b55cd req-4f59d5c0-73e5-4219-aca1-ed95dde83471 tempest-TestInstancesWithCinderVolumes-1817148846 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2', 'name': 'volume-1e5b8461-58fb-439f-86a3-1c77a717616e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f47c570-b2d2-4128-82d2-8406cec9e117', 'enforce_multipath': True} {{(pid=87303) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:35:44 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-6a60be05-a58c-4cdf-9254-6ee5aa0b55cd req-4f59d5c0-73e5-4219-aca1-ed95dde83471 tempest-TestInstancesWithCinderVolumes-1817148846 None] attachment_update completed successfully. Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Flow 'volume_create_manager' (6460bd26-c3b6-4f80-9eec-45c38c7463f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b852b0d-6d79-450a-af77-476cb87aa86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b852b0d-6d79-450a-af77-476cb87aa86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-594804036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4860f365-efe5-440c-9e7f-000c21177b6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0410c3fd5f054f6da0cdf80bd52bf06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:35:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f2b2992c-e4d3-48e3-a390-006d62ad0b97,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:35:45Z,use_quota=True,user_id='2c9d787c57c64da89f3a8b2631aa017a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (733febe6-1885-458e-bf72-9465c57d749a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (733febe6-1885-458e-bf72-9465c57d749a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6591f762-d22a-4de4-a916-599d6238a08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6591f762-d22a-4de4-a916-599d6238a08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4860f365-efe5-440c-9e7f-000c21177b6c', 'volume_name': 'volume-4860f365-efe5-440c-9e7f-000c21177b6c', 'volume_size': 2, 'snapshot_id': 'f2b2992c-e4d3-48e3-a390-006d62ad0b97'}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef545f4-4112-402b-a8f0-04a9f6068fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef545f4-4112-402b-a8f0-04a9f6068fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6975d600-8a7c-44ee-8c26-fd08c3dd3cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:44 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Volume 4860f365-efe5-440c-9e7f-000c21177b6c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4860f365-efe5-440c-9e7f-000c21177b6c', 'volume_size': 2, 'snapshot_id': 'f2b2992c-e4d3-48e3-a390-006d62ad0b97'} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "cinder-quobyte-f2b2992c-e4d3-48e3-a390-006d62ad0b97-4860f365-efe5-440c-9e7f-000c21177b6c" by "_create_volume_from_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-f2b2992c-e4d3-48e3-a390-006d62ad0b97-4860f365-efe5-440c-9e7f-000c21177b6c" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Creating volume 4860f365-efe5-440c-9e7f-000c21177b6c from snapshot f2b2992c-e4d3-48e3-a390-006d62ad0b97 {{(pid=87303) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:35:44 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "cinder-quobyte-4860f365-efe5-440c-9e7f-000c21177b6c" by "_copy_volume_from_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:45 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-4860f365-efe5-440c-9e7f-000c21177b6c" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] snapshot: f2b2992c-e4d3-48e3-a390-006d62ad0b97, volume: 4860f365-efe5-440c-9e7f-000c21177b6c, {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:35:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:45 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ab97de-03d4-4cb3-8496-bcbce045750c]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.f2b2992c-e4d3-48e3-a390-006d62ad0b97 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:45 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.f2b2992c-e4d3-48e3-a390-006d62ad0b97 Jul 07 17:35:45 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:45 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.f2b2992c-e4d3-48e3-a390-006d62ad0b97" returned: 0 in 0.902s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-645152da-5d4c-45d3-8a0f-4d807643b285(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:35:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285 {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:35:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Creating direct copy from snapshot {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:35:45 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2f0cc3-bb49-4313-8d14-5288247684a1]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:46 devstack sudo[102647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285 Jul 07 17:35:46 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:46 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285" returned: 0 in 0.861s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:46 devstack cinder-volume[87303]: DEBUG cinder.utils [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Path /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4860f365-efe5-440c-9e7f-000c21177b6c not found in is_blk_device check {{(pid=87303) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:35:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4860f365-efe5-440c-9e7f-000c21177b6c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:46 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4860f365-efe5-440c-9e7f-000c21177b6c Jul 07 17:35:46 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:52 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4860f365-efe5-440c-9e7f-000c21177b6c" returned: 0 in 5.586s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:52 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93f9f37-3398-41db-b960-bce2bc897558]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:52 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285 Jul 07 17:35:52 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:53 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285" returned: 0 in 1.047s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:53 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Image conversion details: src /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285, size 1024.00 MB, duration 5.59 sec, destination /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4860f365-efe5-440c-9e7f-000c21177b6c {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:35:53 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Converted 1024.00 MB image at 183.29 MB/s Jul 07 17:35:53 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4860f365-efe5-440c-9e7f-000c21177b6c is being set with open permissions: ugo+rw Jul 07 17:35:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4860f365-efe5-440c-9e7f-000c21177b6c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:53 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4860f365-efe5-440c-9e7f-000c21177b6c Jul 07 17:35:53 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:54 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4860f365-efe5-440c-9e7f-000c21177b6c" returned: 0 in 0.772s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:54 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-4860f365-efe5-440c-9e7f-000c21177b6c" released by "_copy_volume_from_snapshot" :: held 9.274s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:54 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-f2b2992c-e4d3-48e3-a390-006d62ad0b97-4860f365-efe5-440c-9e7f-000c21177b6c" released by "_create_volume_from_snapshot" :: held 9.318s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.338s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6975d600-8a7c-44ee-8c26-fd08c3dd3cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4860f365-efe5-440c-9e7f-000c21177b6c', 'volume_size': 2, 'snapshot_id': 'f2b2992c-e4d3-48e3-a390-006d62ad0b97'}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac47f77e-185b-4335-94e5-5f3025380d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:35:54 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Volume volume-4860f365-efe5-440c-9e7f-000c21177b6c (4860f365-efe5-440c-9e7f-000c21177b6c): created successfully Jul 07 17:35:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac47f77e-185b-4335-94e5-5f3025380d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:35:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Flow 'volume_create_manager' (6460bd26-c3b6-4f80-9eec-45c38c7463f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:35:54 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-fdab4883-dd5d-4b5f-859b-17980ea777c2 tempest-VolumesSnapshotTestJSON-1565575080 None] Created volume successfully. Jul 07 17:35:54 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8a4a8509-0232-4aff-ab00-59ffbe497ec9 tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "cinder-4860f365-efe5-440c-9e7f-000c21177b6c-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:54 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8a4a8509-0232-4aff-ab00-59ffbe497ec9 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-4860f365-efe5-440c-9e7f-000c21177b6c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:54 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8a4a8509-0232-4aff-ab00-59ffbe497ec9 tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "cinder-quobyte-4860f365-efe5-440c-9e7f-000c21177b6c" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:54 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8a4a8509-0232-4aff-ab00-59ffbe497ec9 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-4860f365-efe5-440c-9e7f-000c21177b6c" acquired by "delete_volume" :: waited 0.014s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:54 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0f60dc-208b-4a3f-a783-b5a2f3e2b90e]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8a4a8509-0232-4aff-ab00-59ffbe497ec9 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4860f365-efe5-440c-9e7f-000c21177b6c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:54 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4860f365-efe5-440c-9e7f-000c21177b6c Jul 07 17:35:54 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:55 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8a4a8509-0232-4aff-ab00-59ffbe497ec9 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4860f365-efe5-440c-9e7f-000c21177b6c" returned: 0 in 0.846s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8a4a8509-0232-4aff-ab00-59ffbe497ec9 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4860f365-efe5-440c-9e7f-000c21177b6c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:55 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4860f365-efe5-440c-9e7f-000c21177b6c Jul 07 17:35:55 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:55 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-e7c63d3a-8a56-4d8c-a238-5e7462eab9c9 req-d1c15746-7678-409d-b36c-1b8903e62541 tempest-TestInstancesWithCinderVolumes-1817148846 None] Terminate volume connection completed successfully. Jul 07 17:35:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-e7c63d3a-8a56-4d8c-a238-5e7462eab9c9 req-d1c15746-7678-409d-b36c-1b8903e62541 tempest-TestInstancesWithCinderVolumes-1817148846 None] Deleting attachment 871ba857-6e26-4917-b1d0-11555b4cc2a1. {{(pid=87303) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:35:56 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8a4a8509-0232-4aff-ab00-59ffbe497ec9 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4860f365-efe5-440c-9e7f-000c21177b6c" returned: 0 in 0.761s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8a4a8509-0232-4aff-ab00-59ffbe497ec9 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-4860f365-efe5-440c-9e7f-000c21177b6c" released by "delete_volume" :: held 1.648s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:56 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-8a4a8509-0232-4aff-ab00-59ffbe497ec9 tempest-VolumesSnapshotTestJSON-1565575080 None] Created reservations ['cde310fe-d7f5-447a-bb8c-1fb2590b9735', '8c763d20-fa02-4c54-9e24-fbbbb40c17ce', 'd09e58b6-d344-4cfc-a2f1-598cec18db36', '032edac0-5753-49b6-9e70-998a3760b76b'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:35:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8a4a8509-0232-4aff-ab00-59ffbe497ec9 tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8a4a8509-0232-4aff-ab00-59ffbe497ec9 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-8a4a8509-0232-4aff-ab00-59ffbe497ec9 tempest-VolumesSnapshotTestJSON-1565575080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-8a4a8509-0232-4aff-ab00-59ffbe497ec9 tempest-VolumesSnapshotTestJSON-1565575080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8a4a8509-0232-4aff-ab00-59ffbe497ec9 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8a4a8509-0232-4aff-ab00-59ffbe497ec9 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:56 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:35:56 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:35:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:56 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:35:56 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f5d3a34b-4e1b-4bb8-939a-26c6cdf5906b tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "cinder-f2b2992c-e4d3-48e3-a390-006d62ad0b97-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f5d3a34b-4e1b-4bb8-939a-26c6cdf5906b tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-f2b2992c-e4d3-48e3-a390-006d62ad0b97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f5d3a34b-4e1b-4bb8-939a-26c6cdf5906b tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "cinder-quobyte-645152da-5d4c-45d3-8a0f-4d807643b285" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f5d3a34b-4e1b-4bb8-939a-26c6cdf5906b tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-645152da-5d4c-45d3-8a0f-4d807643b285" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f5d3a34b-4e1b-4bb8-939a-26c6cdf5906b tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "cinder-quobyte-f2b2992c-e4d3-48e3-a390-006d62ad0b97" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f5d3a34b-4e1b-4bb8-939a-26c6cdf5906b tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-f2b2992c-e4d3-48e3-a390-006d62ad0b97" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-f5d3a34b-4e1b-4bb8-939a-26c6cdf5906b tempest-VolumesSnapshotTestJSON-1565575080 None] Deleting offline snapshot f2b2992c-e4d3-48e3-a390-006d62ad0b97 of volume 645152da-5d4c-45d3-8a0f-4d807643b285 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:35:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-f5d3a34b-4e1b-4bb8-939a-26c6cdf5906b tempest-VolumesSnapshotTestJSON-1565575080 None] snapshot_file for this snap is: volume-645152da-5d4c-45d3-8a0f-4d807643b285.f2b2992c-e4d3-48e3-a390-006d62ad0b97 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:35:57 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd33e650-83f6-4bcb-b468-f36d6c5b577f]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f5d3a34b-4e1b-4bb8-939a-26c6cdf5906b tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.f2b2992c-e4d3-48e3-a390-006d62ad0b97 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:57 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.f2b2992c-e4d3-48e3-a390-006d62ad0b97 Jul 07 17:35:57 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:57 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8a4a8509-0232-4aff-ab00-59ffbe497ec9 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.803s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-8a4a8509-0232-4aff-ab00-59ffbe497ec9 tempest-VolumesSnapshotTestJSON-1565575080 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:35:57 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-8a4a8509-0232-4aff-ab00-59ffbe497ec9 tempest-VolumesSnapshotTestJSON-1565575080 None] Deleted volume successfully. Jul 07 17:35:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8a4a8509-0232-4aff-ab00-59ffbe497ec9 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-4860f365-efe5-440c-9e7f-000c21177b6c-delete_volume" released by "delete_volume" :: held 2.694s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:57 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.780s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:35:57 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:35:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:35:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:35:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0bb37f04-bd97-427b-940b-c4c8a6765318 tempest-TestInstancesWithCinderVolumes-1817148846 None] Acquiring lock "cinder-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0bb37f04-bd97-427b-940b-c4c8a6765318 tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "cinder-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0bb37f04-bd97-427b-940b-c4c8a6765318 tempest-TestInstancesWithCinderVolumes-1817148846 None] Acquiring lock "cinder-quobyte-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:35:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0bb37f04-bd97-427b-940b-c4c8a6765318 tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "cinder-quobyte-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0" acquired by "delete_volume" :: waited 0.018s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:35:57 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a758fe4-f638-46cb-8f95-7d8a648e9ea0]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0bb37f04-bd97-427b-940b-c4c8a6765318 tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:57 devstack sudo[102766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0 Jul 07 17:35:57 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:58 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f5d3a34b-4e1b-4bb8-939a-26c6cdf5906b tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.f2b2992c-e4d3-48e3-a390-006d62ad0b97" returned: 0 in 0.939s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:58 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-f5d3a34b-4e1b-4bb8-939a-26c6cdf5906b tempest-VolumesSnapshotTestJSON-1565575080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-645152da-5d4c-45d3-8a0f-4d807643b285(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:35:58 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[703e8dd6-5724-4af9-8022-4d9c26ac8da7]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:35:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f5d3a34b-4e1b-4bb8-939a-26c6cdf5906b tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:58 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285 Jul 07 17:35:58 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:58 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0bb37f04-bd97-427b-940b-c4c8a6765318 tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0" returned: 0 in 0.913s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0bb37f04-bd97-427b-940b-c4c8a6765318 tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:58 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0 Jul 07 17:35:58 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:58 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f5d3a34b-4e1b-4bb8-939a-26c6cdf5906b tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285" returned: 0 in 0.842s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f5d3a34b-4e1b-4bb8-939a-26c6cdf5906b tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.f2b2992c-e4d3-48e3-a390-006d62ad0b97 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:58 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.f2b2992c-e4d3-48e3-a390-006d62ad0b97 Jul 07 17:35:58 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:59 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0bb37f04-bd97-427b-940b-c4c8a6765318 tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0" returned: 0 in 0.799s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0bb37f04-bd97-427b-940b-c4c8a6765318 tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "cinder-quobyte-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0" released by "delete_volume" :: held 1.758s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:35:59 devstack cinder-volume[87303]: WARNING cinder.quota [None req-0bb37f04-bd97-427b-940b-c4c8a6765318 tempest-TestInstancesWithCinderVolumes-1817148846 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1416049379-479295702 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1416049379-479295702, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:35:59 devstack cinder-volume[87303]: WARNING cinder.quota [None req-0bb37f04-bd97-427b-940b-c4c8a6765318 tempest-TestInstancesWithCinderVolumes-1817148846 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1416049379-479295702 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1416049379-479295702, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:35:59 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-0bb37f04-bd97-427b-940b-c4c8a6765318 tempest-TestInstancesWithCinderVolumes-1817148846 None] Created reservations ['eae1666d-6ae2-4bd4-920f-554e7dff5503', 'a93207f4-52de-4dd9-97c0-af7cefe001a2', 'abb4aa2d-dd9d-44e8-b2e7-7db0de7419ad', '916a91c7-4adc-4762-ae95-2567e4460d7f'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:35:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0bb37f04-bd97-427b-940b-c4c8a6765318 tempest-TestInstancesWithCinderVolumes-1817148846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:35:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0bb37f04-bd97-427b-940b-c4c8a6765318 tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:35:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0bb37f04-bd97-427b-940b-c4c8a6765318 tempest-TestInstancesWithCinderVolumes-1817148846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:35:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0bb37f04-bd97-427b-940b-c4c8a6765318 tempest-TestInstancesWithCinderVolumes-1817148846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:35:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0bb37f04-bd97-427b-940b-c4c8a6765318 tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:35:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0bb37f04-bd97-427b-940b-c4c8a6765318 tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:59 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:35:59 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:35:59 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Jul 07 17:35:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f5d3a34b-4e1b-4bb8-939a-26c6cdf5906b tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.f2b2992c-e4d3-48e3-a390-006d62ad0b97" returned: 0 in 0.881s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:35:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f5d3a34b-4e1b-4bb8-939a-26c6cdf5906b tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.f2b2992c-e4d3-48e3-a390-006d62ad0b97 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:35:59 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.f2b2992c-e4d3-48e3-a390-006d62ad0b97 Jul 07 17:35:59 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:00 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:00 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0bb37f04-bd97-427b-940b-c4c8a6765318 tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.835s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f5d3a34b-4e1b-4bb8-939a-26c6cdf5906b tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285.f2b2992c-e4d3-48e3-a390-006d62ad0b97" returned: 0 in 0.726s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:00 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-0bb37f04-bd97-427b-940b-c4c8a6765318 tempest-TestInstancesWithCinderVolumes-1817148846 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:36:00 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-0bb37f04-bd97-427b-940b-c4c8a6765318 tempest-TestInstancesWithCinderVolumes-1817148846 None] Deleted volume successfully. Jul 07 17:36:00 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f5d3a34b-4e1b-4bb8-939a-26c6cdf5906b tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-f2b2992c-e4d3-48e3-a390-006d62ad0b97" released by "_delete_snapshot" :: held 3.563s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:00 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0bb37f04-bd97-427b-940b-c4c8a6765318 tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "cinder-efccc3d9-83ed-42fb-92f1-b5aaf5c18dc0-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:00 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f5d3a34b-4e1b-4bb8-939a-26c6cdf5906b tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-645152da-5d4c-45d3-8a0f-4d807643b285" released by "delete_snapshot" :: held 3.595s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:00 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-f5d3a34b-4e1b-4bb8-939a-26c6cdf5906b tempest-VolumesSnapshotTestJSON-1565575080 None] Created reservations ['8e23b397-1c50-4af5-a7b0-afcb0c55c2b6', 'a605ac6e-2ce4-4977-ac18-48d02d530758', 'bf928194-8266-4a11-a624-125fbfaba08e', '5d8b46b0-e734-4724-af3e-b47d599f5007'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:36:00 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-f5d3a34b-4e1b-4bb8-939a-26c6cdf5906b tempest-VolumesSnapshotTestJSON-1565575080 None] Delete snapshot completed successfully. Jul 07 17:36:00 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f5d3a34b-4e1b-4bb8-939a-26c6cdf5906b tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-f2b2992c-e4d3-48e3-a390-006d62ad0b97-delete_snapshot" released by "delete_snapshot" :: held 3.816s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-011b0f8e-3a66-44a2-9c16-1b0a31eddcab tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "cinder-645152da-5d4c-45d3-8a0f-4d807643b285-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-011b0f8e-3a66-44a2-9c16-1b0a31eddcab tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-645152da-5d4c-45d3-8a0f-4d807643b285-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-011b0f8e-3a66-44a2-9c16-1b0a31eddcab tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "cinder-quobyte-645152da-5d4c-45d3-8a0f-4d807643b285" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-011b0f8e-3a66-44a2-9c16-1b0a31eddcab tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-645152da-5d4c-45d3-8a0f-4d807643b285" acquired by "delete_volume" :: waited 0.017s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:01 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[130e90e7-aec6-42eb-9056-c591eb52ed91]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-011b0f8e-3a66-44a2-9c16-1b0a31eddcab tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:01 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285 Jul 07 17:36:01 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:02 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-011b0f8e-3a66-44a2-9c16-1b0a31eddcab tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285" returned: 0 in 0.939s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-011b0f8e-3a66-44a2-9c16-1b0a31eddcab tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:02 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285 Jul 07 17:36:02 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:02 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-7cf8eb56-3a0d-4016-a36f-93ce8b2d8ed1 req-80c2c8a5-c0dc-4b98-a542-791e2c140d98 tempest-TestInstancesWithCinderVolumes-1817148846 None] Terminate volume connection completed successfully. Jul 07 17:36:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-7cf8eb56-3a0d-4016-a36f-93ce8b2d8ed1 req-80c2c8a5-c0dc-4b98-a542-791e2c140d98 tempest-TestInstancesWithCinderVolumes-1817148846 None] Deleting attachment 3f47c570-b2d2-4128-82d2-8406cec9e117. {{(pid=87303) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:36:03 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-011b0f8e-3a66-44a2-9c16-1b0a31eddcab tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-645152da-5d4c-45d3-8a0f-4d807643b285" returned: 0 in 0.724s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-011b0f8e-3a66-44a2-9c16-1b0a31eddcab tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-645152da-5d4c-45d3-8a0f-4d807643b285" released by "delete_volume" :: held 1.756s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:03 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-011b0f8e-3a66-44a2-9c16-1b0a31eddcab tempest-VolumesSnapshotTestJSON-1565575080 None] Created reservations ['474dc958-853b-47ae-9b0d-dd156e887a5c', '850cd482-e87f-4359-820f-992e091260ba', 'daffa145-284f-4b10-a7cd-c34a461cd033', 'd489e75f-0036-4823-8f9d-5c165766440f'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:36:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-011b0f8e-3a66-44a2-9c16-1b0a31eddcab tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-011b0f8e-3a66-44a2-9c16-1b0a31eddcab tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:03 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-011b0f8e-3a66-44a2-9c16-1b0a31eddcab tempest-VolumesSnapshotTestJSON-1565575080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:03 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-011b0f8e-3a66-44a2-9c16-1b0a31eddcab tempest-VolumesSnapshotTestJSON-1565575080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-011b0f8e-3a66-44a2-9c16-1b0a31eddcab tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-011b0f8e-3a66-44a2-9c16-1b0a31eddcab tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:03 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:36:03 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:04 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-011b0f8e-3a66-44a2-9c16-1b0a31eddcab tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.783s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-011b0f8e-3a66-44a2-9c16-1b0a31eddcab tempest-VolumesSnapshotTestJSON-1565575080 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:36:04 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-011b0f8e-3a66-44a2-9c16-1b0a31eddcab tempest-VolumesSnapshotTestJSON-1565575080 None] Deleted volume successfully. Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-011b0f8e-3a66-44a2-9c16-1b0a31eddcab tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-645152da-5d4c-45d3-8a0f-4d807643b285-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Flow 'volume_create_manager' (f6d68ebd-e5eb-41d0-af43-da622c56e041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0f06db-31bc-46fa-952f-e95e365f9c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0f06db-31bc-46fa-952f-e95e365f9c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1290752020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be50149b-80d1-41d9-b388-62f04dfacbb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0410c3fd5f054f6da0cdf80bd52bf06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:04Z,use_quota=True,user_id='2c9d787c57c64da89f3a8b2631aa017a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9678b6a-b057-40e5-870a-fa4546be1ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9678b6a-b057-40e5-870a-fa4546be1ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f59d6c4e-3f36-44e3-9c0d-7353ff7ac14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f59d6c4e-3f36-44e3-9c0d-7353ff7ac14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be50149b-80d1-41d9-b388-62f04dfacbb9', 'volume_name': 'volume-be50149b-80d1-41d9-b388-62f04dfacbb9', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c61615-9a3d-4586-b073-4c4ec551e219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c61615-9a3d-4586-b073-4c4ec551e219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5319d4-f527-4a72-a60c-933a2df758a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:04 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Volume be50149b-80d1-41d9-b388-62f04dfacbb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be50149b-80d1-41d9-b388-62f04dfacbb9', 'volume_size': 1} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1290752020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be50149b-80d1-41d9-b388-62f04dfacbb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0410c3fd5f054f6da0cdf80bd52bf06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:04Z,use_quota=True,user_id='2c9d787c57c64da89f3a8b2631aa017a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Creating volume be50149b-80d1-41d9-b388-62f04dfacbb9 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:36:04 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:04 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9 1073741824 Jul 07 17:36:04 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1e473bf2-2cde-40ce-b9ef-f53a8018984a tempest-TestInstancesWithCinderVolumes-1817148846 None] Acquiring lock "cinder-1e5b8461-58fb-439f-86a3-1c77a717616e-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1e473bf2-2cde-40ce-b9ef-f53a8018984a tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "cinder-1e5b8461-58fb-439f-86a3-1c77a717616e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1e473bf2-2cde-40ce-b9ef-f53a8018984a tempest-TestInstancesWithCinderVolumes-1817148846 None] Acquiring lock "cinder-quobyte-1e5b8461-58fb-439f-86a3-1c77a717616e" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1e473bf2-2cde-40ce-b9ef-f53a8018984a tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "cinder-quobyte-1e5b8461-58fb-439f-86a3-1c77a717616e" acquired by "delete_volume" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca69359-ded6-42a4-93bc-b93b31c41c12]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1e473bf2-2cde-40ce-b9ef-f53a8018984a tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1e5b8461-58fb-439f-86a3-1c77a717616e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:04 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1e5b8461-58fb-439f-86a3-1c77a717616e Jul 07 17:36:04 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:05 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9 1073741824" returned: 0 in 1.065s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:05 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9 Jul 07 17:36:05 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:05 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1e473bf2-2cde-40ce-b9ef-f53a8018984a tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1e5b8461-58fb-439f-86a3-1c77a717616e" returned: 0 in 0.984s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1e473bf2-2cde-40ce-b9ef-f53a8018984a tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1e5b8461-58fb-439f-86a3-1c77a717616e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:05 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1e5b8461-58fb-439f-86a3-1c77a717616e Jul 07 17:36:05 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:06 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9" returned: 0 in 0.911s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] <== create_volume: return (2032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:36:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5319d4-f527-4a72-a60c-933a2df758a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be50149b-80d1-41d9-b388-62f04dfacbb9', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced4ddb9-c764-4fb7-9062-bd1ea5c2d52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:06 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Volume volume-be50149b-80d1-41d9-b388-62f04dfacbb9 (be50149b-80d1-41d9-b388-62f04dfacbb9): created successfully Jul 07 17:36:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced4ddb9-c764-4fb7-9062-bd1ea5c2d52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Flow 'volume_create_manager' (f6d68ebd-e5eb-41d0-af43-da622c56e041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:06 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-539cfeb7-6b68-48c2-9501-1c3763f08b30 tempest-VolumesSnapshotTestJSON-1565575080 None] Created volume successfully. Jul 07 17:36:06 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1e473bf2-2cde-40ce-b9ef-f53a8018984a tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-1e5b8461-58fb-439f-86a3-1c77a717616e" returned: 0 in 0.871s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1e473bf2-2cde-40ce-b9ef-f53a8018984a tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "cinder-quobyte-1e5b8461-58fb-439f-86a3-1c77a717616e" released by "delete_volume" :: held 1.914s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:06 devstack cinder-volume[87303]: WARNING cinder.quota [None req-1e473bf2-2cde-40ce-b9ef-f53a8018984a tempest-TestInstancesWithCinderVolumes-1817148846 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-217831339-1664379754 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-217831339-1664379754, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:36:06 devstack cinder-volume[87303]: WARNING cinder.quota [None req-1e473bf2-2cde-40ce-b9ef-f53a8018984a tempest-TestInstancesWithCinderVolumes-1817148846 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-217831339-1664379754 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-217831339-1664379754, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:36:06 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-1e473bf2-2cde-40ce-b9ef-f53a8018984a tempest-TestInstancesWithCinderVolumes-1817148846 None] Created reservations ['7c22f997-5245-4f5a-ae6c-0f1864af1695', 'ed2d8975-eafa-4210-b818-0f29ca25b762', 'e1ae7002-d402-493b-b78c-f9cacca43c72', '485e89c3-621c-4548-90f1-4a5334d57cd1'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:36:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1e473bf2-2cde-40ce-b9ef-f53a8018984a tempest-TestInstancesWithCinderVolumes-1817148846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1e473bf2-2cde-40ce-b9ef-f53a8018984a tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1e473bf2-2cde-40ce-b9ef-f53a8018984a tempest-TestInstancesWithCinderVolumes-1817148846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1e473bf2-2cde-40ce-b9ef-f53a8018984a tempest-TestInstancesWithCinderVolumes-1817148846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1e473bf2-2cde-40ce-b9ef-f53a8018984a tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1e473bf2-2cde-40ce-b9ef-f53a8018984a tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:06 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:36:06 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:07 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1e473bf2-2cde-40ce-b9ef-f53a8018984a tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.802s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:07 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-1e473bf2-2cde-40ce-b9ef-f53a8018984a tempest-TestInstancesWithCinderVolumes-1817148846 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:36:07 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-1e473bf2-2cde-40ce-b9ef-f53a8018984a tempest-TestInstancesWithCinderVolumes-1817148846 None] Deleted volume successfully. Jul 07 17:36:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1e473bf2-2cde-40ce-b9ef-f53a8018984a tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "cinder-1e5b8461-58fb-439f-86a3-1c77a717616e-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-287badd3-8a06-4918-9595-fc8012e3c229 tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-287badd3-8a06-4918-9595-fc8012e3c229 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-287badd3-8a06-4918-9595-fc8012e3c229 tempest-VolumesSnapshotTestJSON-1565575080 None] Creating offline snapshot 019976a6-eff0-4639-839a-1d17283d9082 of volume be50149b-80d1-41d9-b388-62f04dfacbb9 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:36:07 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d985dce-a380-4bcf-8418-d218bd1fa004]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-287badd3-8a06-4918-9595-fc8012e3c229 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:07 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9 Jul 07 17:36:07 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:08 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-287badd3-8a06-4918-9595-fc8012e3c229 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9" returned: 0 in 0.908s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-287badd3-8a06-4918-9595-fc8012e3c229 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.019976a6-eff0-4639-839a-1d17283d9082 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:08 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.019976a6-eff0-4639-839a-1d17283d9082 1G Jul 07 17:36:08 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:09 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-287badd3-8a06-4918-9595-fc8012e3c229 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.019976a6-eff0-4639-839a-1d17283d9082 1G" returned: 0 in 1.011s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-287badd3-8a06-4918-9595-fc8012e3c229 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be50149b-80d1-41d9-b388-62f04dfacbb9 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.019976a6-eff0-4639-839a-1d17283d9082 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:09 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be50149b-80d1-41d9-b388-62f04dfacbb9 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.019976a6-eff0-4639-839a-1d17283d9082 Jul 07 17:36:09 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:10 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-287badd3-8a06-4918-9595-fc8012e3c229 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be50149b-80d1-41d9-b388-62f04dfacbb9 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.019976a6-eff0-4639-839a-1d17283d9082" returned: 0 in 0.963s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:10 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-287badd3-8a06-4918-9595-fc8012e3c229 tempest-VolumesSnapshotTestJSON-1565575080 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.019976a6-eff0-4639-839a-1d17283d9082 is being set with open permissions: ugo+rw Jul 07 17:36:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-287badd3-8a06-4918-9595-fc8012e3c229 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.019976a6-eff0-4639-839a-1d17283d9082 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:10 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.019976a6-eff0-4639-839a-1d17283d9082 Jul 07 17:36:10 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:11 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-287badd3-8a06-4918-9595-fc8012e3c229 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.019976a6-eff0-4639-839a-1d17283d9082" returned: 0 in 0.776s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:11 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=79,cinder:INSERT=21,cinder:UPDATE=83,cinder:DELETE=4 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:36:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-287badd3-8a06-4918-9595-fc8012e3c229 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:11 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.info Jul 07 17:36:11 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:12 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-287badd3-8a06-4918-9595-fc8012e3c229 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.info" returned: 0 in 0.747s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:12 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-287badd3-8a06-4918-9595-fc8012e3c229 tempest-VolumesSnapshotTestJSON-1565575080 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.info is being set with open permissions: ugo+rw Jul 07 17:36:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-287badd3-8a06-4918-9595-fc8012e3c229 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:12 devstack sudo[102901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.info Jul 07 17:36:12 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:12 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-adcf6d1f-62c3-4bab-913a-7e2ca55d0176 req-77f3861a-060e-47f6-852d-64e5686c6ede tempest-TestInstancesWithCinderVolumes-1817148846 None] Terminate volume connection completed successfully. Jul 07 17:36:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-adcf6d1f-62c3-4bab-913a-7e2ca55d0176 req-77f3861a-060e-47f6-852d-64e5686c6ede tempest-TestInstancesWithCinderVolumes-1817148846 None] Deleting attachment 768095d5-3136-4fc1-b106-2bb6acaa004f. {{(pid=87303) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:36:13 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-287badd3-8a06-4918-9595-fc8012e3c229 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.info" returned: 0 in 0.802s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-287badd3-8a06-4918-9595-fc8012e3c229 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.307s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:13 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-287badd3-8a06-4918-9595-fc8012e3c229 tempest-VolumesSnapshotTestJSON-1565575080 None] Create snapshot completed successfully Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Flow 'volume_create_manager' (390489cc-5cf7-42d7-9dba-c636f4b44a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a172974-ee77-48ef-82dd-a8931ac6b816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a172974-ee77-48ef-82dd-a8931ac6b816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1892824787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd72ea87-2bc4-4878-aab1-088ca7ae7eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0410c3fd5f054f6da0cdf80bd52bf06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=019976a6-eff0-4639-839a-1d17283d9082,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:36:15Z,use_quota=True,user_id='2c9d787c57c64da89f3a8b2631aa017a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf05310-7769-4c59-a87a-fa2fb888c18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf05310-7769-4c59-a87a-fa2fb888c18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5eefa5-ef7a-4bc7-9d51-14f07890b07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5eefa5-ef7a-4bc7-9d51-14f07890b07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dd72ea87-2bc4-4878-aab1-088ca7ae7eb7', 'volume_name': 'volume-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7', 'volume_size': 1, 'snapshot_id': '019976a6-eff0-4639-839a-1d17283d9082'}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf1f12a-578b-4840-8bb8-c18979700ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf1f12a-578b-4840-8bb8-c18979700ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e11c4fc-c983-457c-9441-8aff1891775f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:14 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Volume dd72ea87-2bc4-4878-aab1-088ca7ae7eb7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7', 'volume_size': 1, 'snapshot_id': '019976a6-eff0-4639-839a-1d17283d9082'} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "cinder-quobyte-019976a6-eff0-4639-839a-1d17283d9082-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7" by "_create_volume_from_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-019976a6-eff0-4639-839a-1d17283d9082-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Creating volume dd72ea87-2bc4-4878-aab1-088ca7ae7eb7 from snapshot 019976a6-eff0-4639-839a-1d17283d9082 {{(pid=87303) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "cinder-quobyte-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7" by "_copy_volume_from_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] snapshot: 019976a6-eff0-4639-839a-1d17283d9082, volume: dd72ea87-2bc4-4878-aab1-088ca7ae7eb7, {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[563d8b20-01b6-4151-89c2-c03d15851c2b]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.019976a6-eff0-4639-839a-1d17283d9082 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:15 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.019976a6-eff0-4639-839a-1d17283d9082 Jul 07 17:36:15 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] Acquiring lock "cinder-30da1435-61b9-4d93-9a96-9acac62fbf45-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "cinder-30da1435-61b9-4d93-9a96-9acac62fbf45-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] Acquiring lock "cinder-quobyte-30da1435-61b9-4d93-9a96-9acac62fbf45" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "cinder-quobyte-30da1435-61b9-4d93-9a96-9acac62fbf45" acquired by "delete_volume" :: waited 0.026s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:15 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c64e749-542e-49ff-bcdb-30af0a80089f]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:15 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 Jul 07 17:36:15 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:15 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.019976a6-eff0-4639-839a-1d17283d9082" returned: 0 in 1.004s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be50149b-80d1-41d9-b388-62f04dfacbb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:36:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9 {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:36:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Creating direct copy from snapshot {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:36:15 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacdba4a-9d58-4ab0-9b43-1e1f80940b58]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:16 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9 Jul 07 17:36:16 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:16 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45" returned: 0 in 0.913s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:16 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 Jul 07 17:36:16 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:16 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9" returned: 0 in 0.965s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:16 devstack cinder-volume[87303]: DEBUG cinder.utils [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Path /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7 not found in is_blk_device check {{(pid=87303) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:36:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:16 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7 Jul 07 17:36:16 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:17 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45" returned: 1 in 0.871s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:36:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:17 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45 Jul 07 17:36:17 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:19 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-30da1435-61b9-4d93-9a96-9acac62fbf45" returned: 0 in 1.923s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "cinder-quobyte-30da1435-61b9-4d93-9a96-9acac62fbf45" released by "delete_volume" :: held 3.821s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:19 devstack cinder-volume[87303]: WARNING cinder.quota [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-396092404-2009916303 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-396092404-2009916303, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:36:19 devstack cinder-volume[87303]: WARNING cinder.quota [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-396092404-2009916303 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-396092404-2009916303, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:36:19 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] Created reservations ['b06504dd-ea3a-4cdd-9efd-00956f3f8eef', 'efe18642-c7f9-4388-b669-62a03411812b', 'aff3b4fb-65bb-4ce9-a4ef-b462f1cfb06b', '6f9c6f24-9901-4f37-90a6-e9eb108faba2'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:36:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:19 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:36:19 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:22 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 2.134s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:22 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:36:22 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] Deleted volume successfully. Jul 07 17:36:22 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-17ea710d-ab16-4ed5-bd11-ae0c931ab0b6 tempest-TestInstancesWithCinderVolumes-1817148846 None] Lock "cinder-30da1435-61b9-4d93-9a96-9acac62fbf45-delete_volume" released by "delete_volume" :: held 6.557s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:22 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7" returned: 0 in 5.715s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:22 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[091fa85c-0ec5-4437-86b3-245ba0dba700]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:22 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9 Jul 07 17:36:22 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:23 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9" returned: 0 in 1.063s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:23 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Image conversion details: src /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7 {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:36:23 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Converted 1024.00 MB image at 179.12 MB/s Jul 07 17:36:23 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7 is being set with open permissions: ugo+rw Jul 07 17:36:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:23 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7 Jul 07 17:36:23 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:24 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7" returned: 0 in 0.807s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7" released by "_copy_volume_from_snapshot" :: held 9.677s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-019976a6-eff0-4639-839a-1d17283d9082-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7" released by "_create_volume_from_snapshot" :: held 9.711s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.726s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e11c4fc-c983-457c-9441-8aff1891775f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7', 'volume_size': 1, 'snapshot_id': '019976a6-eff0-4639-839a-1d17283d9082'}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821a3fdf-cfdb-4623-a702-c1486767252a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:36:24 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Volume volume-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7 (dd72ea87-2bc4-4878-aab1-088ca7ae7eb7): created successfully Jul 07 17:36:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821a3fdf-cfdb-4623-a702-c1486767252a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:36:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Flow 'volume_create_manager' (390489cc-5cf7-42d7-9dba-c636f4b44a40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:36:24 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-2ebc2cc8-17ed-48c8-a3d9-fe3ae0414b3f tempest-VolumesSnapshotTestJSON-1565575080 None] Created volume successfully. Jul 07 17:36:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7bf40a72-e9db-49b7-a1a8-c19895f2eb3a tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "cinder-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7bf40a72-e9db-49b7-a1a8-c19895f2eb3a tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7bf40a72-e9db-49b7-a1a8-c19895f2eb3a tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "cinder-quobyte-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7bf40a72-e9db-49b7-a1a8-c19895f2eb3a tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7" acquired by "delete_volume" :: waited 0.026s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:25 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f1f931-0b81-459a-a565-976f17e268bc]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7bf40a72-e9db-49b7-a1a8-c19895f2eb3a tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:25 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7 Jul 07 17:36:25 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:26 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7bf40a72-e9db-49b7-a1a8-c19895f2eb3a tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7" returned: 0 in 0.934s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7bf40a72-e9db-49b7-a1a8-c19895f2eb3a tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:26 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7 Jul 07 17:36:26 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:26 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7bf40a72-e9db-49b7-a1a8-c19895f2eb3a tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7" returned: 0 in 0.806s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7bf40a72-e9db-49b7-a1a8-c19895f2eb3a tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7" released by "delete_volume" :: held 1.786s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:26 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-7bf40a72-e9db-49b7-a1a8-c19895f2eb3a tempest-VolumesSnapshotTestJSON-1565575080 None] Created reservations ['6c060f9d-bc26-43d9-8465-b235028dcb13', '97980b9b-36f5-4dfa-855d-4f82a0d623ab', '4b4aab17-7c21-4a0e-949d-96ef1e79086d', '27ed1b25-59c0-4c4c-9d0f-40849c5c3954'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:36:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7bf40a72-e9db-49b7-a1a8-c19895f2eb3a tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7bf40a72-e9db-49b7-a1a8-c19895f2eb3a tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7bf40a72-e9db-49b7-a1a8-c19895f2eb3a tempest-VolumesSnapshotTestJSON-1565575080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7bf40a72-e9db-49b7-a1a8-c19895f2eb3a tempest-VolumesSnapshotTestJSON-1565575080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7bf40a72-e9db-49b7-a1a8-c19895f2eb3a tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7bf40a72-e9db-49b7-a1a8-c19895f2eb3a tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:27 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:36:27 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dfbeefe4-ba63-4983-9ef3-f936f2401560 tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "cinder-019976a6-eff0-4639-839a-1d17283d9082-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dfbeefe4-ba63-4983-9ef3-f936f2401560 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-019976a6-eff0-4639-839a-1d17283d9082-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dfbeefe4-ba63-4983-9ef3-f936f2401560 tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "cinder-quobyte-be50149b-80d1-41d9-b388-62f04dfacbb9" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dfbeefe4-ba63-4983-9ef3-f936f2401560 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-be50149b-80d1-41d9-b388-62f04dfacbb9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dfbeefe4-ba63-4983-9ef3-f936f2401560 tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "cinder-quobyte-019976a6-eff0-4639-839a-1d17283d9082" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dfbeefe4-ba63-4983-9ef3-f936f2401560 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-019976a6-eff0-4639-839a-1d17283d9082" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-dfbeefe4-ba63-4983-9ef3-f936f2401560 tempest-VolumesSnapshotTestJSON-1565575080 None] Deleting offline snapshot 019976a6-eff0-4639-839a-1d17283d9082 of volume be50149b-80d1-41d9-b388-62f04dfacbb9 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:36:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-dfbeefe4-ba63-4983-9ef3-f936f2401560 tempest-VolumesSnapshotTestJSON-1565575080 None] snapshot_file for this snap is: volume-be50149b-80d1-41d9-b388-62f04dfacbb9.019976a6-eff0-4639-839a-1d17283d9082 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:36:27 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[33714f72-d707-49f5-afa3-6c769b0964cb]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dfbeefe4-ba63-4983-9ef3-f936f2401560 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.019976a6-eff0-4639-839a-1d17283d9082 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:27 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.019976a6-eff0-4639-839a-1d17283d9082 Jul 07 17:36:27 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:27 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7bf40a72-e9db-49b7-a1a8-c19895f2eb3a tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.856s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:27 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-7bf40a72-e9db-49b7-a1a8-c19895f2eb3a tempest-VolumesSnapshotTestJSON-1565575080 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:36:27 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-7bf40a72-e9db-49b7-a1a8-c19895f2eb3a tempest-VolumesSnapshotTestJSON-1565575080 None] Deleted volume successfully. Jul 07 17:36:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7bf40a72-e9db-49b7-a1a8-c19895f2eb3a tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-dd72ea87-2bc4-4878-aab1-088ca7ae7eb7-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:28 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dfbeefe4-ba63-4983-9ef3-f936f2401560 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.019976a6-eff0-4639-839a-1d17283d9082" returned: 0 in 0.957s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-dfbeefe4-ba63-4983-9ef3-f936f2401560 tempest-VolumesSnapshotTestJSON-1565575080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be50149b-80d1-41d9-b388-62f04dfacbb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:36:28 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dac954-5fe4-4863-bc83-1a6868fb9cda]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dfbeefe4-ba63-4983-9ef3-f936f2401560 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:28 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9 Jul 07 17:36:28 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:29 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dfbeefe4-ba63-4983-9ef3-f936f2401560 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9" returned: 0 in 0.878s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dfbeefe4-ba63-4983-9ef3-f936f2401560 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.019976a6-eff0-4639-839a-1d17283d9082 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:29 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.019976a6-eff0-4639-839a-1d17283d9082 Jul 07 17:36:29 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:30 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dfbeefe4-ba63-4983-9ef3-f936f2401560 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.019976a6-eff0-4639-839a-1d17283d9082" returned: 0 in 0.828s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dfbeefe4-ba63-4983-9ef3-f936f2401560 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.019976a6-eff0-4639-839a-1d17283d9082 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:30 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.019976a6-eff0-4639-839a-1d17283d9082 Jul 07 17:36:30 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:30 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dfbeefe4-ba63-4983-9ef3-f936f2401560 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9.019976a6-eff0-4639-839a-1d17283d9082" returned: 0 in 0.697s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dfbeefe4-ba63-4983-9ef3-f936f2401560 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-019976a6-eff0-4639-839a-1d17283d9082" released by "_delete_snapshot" :: held 3.496s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dfbeefe4-ba63-4983-9ef3-f936f2401560 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-be50149b-80d1-41d9-b388-62f04dfacbb9" released by "delete_snapshot" :: held 3.522s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:30 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-dfbeefe4-ba63-4983-9ef3-f936f2401560 tempest-VolumesSnapshotTestJSON-1565575080 None] Created reservations ['6b5e6959-911a-40c4-8719-0141294ebae4', '6a5c374a-ebb6-4aaf-bfeb-12569086bd6f', 'e9731f19-2461-441a-b57d-48cd1b57018d', '664bfbfd-fa6e-4306-893f-e055abbdc87c'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:36:31 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-dfbeefe4-ba63-4983-9ef3-f936f2401560 tempest-VolumesSnapshotTestJSON-1565575080 None] Delete snapshot completed successfully. Jul 07 17:36:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dfbeefe4-ba63-4983-9ef3-f936f2401560 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-019976a6-eff0-4639-839a-1d17283d9082-delete_snapshot" released by "delete_snapshot" :: held 3.780s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a2179db8-bb82-4379-95c7-a1bdfe173c91 tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "cinder-be50149b-80d1-41d9-b388-62f04dfacbb9-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a2179db8-bb82-4379-95c7-a1bdfe173c91 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-be50149b-80d1-41d9-b388-62f04dfacbb9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a2179db8-bb82-4379-95c7-a1bdfe173c91 tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "cinder-quobyte-be50149b-80d1-41d9-b388-62f04dfacbb9" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a2179db8-bb82-4379-95c7-a1bdfe173c91 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-be50149b-80d1-41d9-b388-62f04dfacbb9" acquired by "delete_volume" :: waited 0.020s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:31 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe72a1a-d39a-40c2-ae81-5b6ca01d5818]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a2179db8-bb82-4379-95c7-a1bdfe173c91 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:31 devstack sudo[102991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9 Jul 07 17:36:31 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:32 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a2179db8-bb82-4379-95c7-a1bdfe173c91 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9" returned: 0 in 0.895s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a2179db8-bb82-4379-95c7-a1bdfe173c91 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:32 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9 Jul 07 17:36:32 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:33 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a2179db8-bb82-4379-95c7-a1bdfe173c91 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-be50149b-80d1-41d9-b388-62f04dfacbb9" returned: 0 in 0.734s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a2179db8-bb82-4379-95c7-a1bdfe173c91 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-be50149b-80d1-41d9-b388-62f04dfacbb9" released by "delete_volume" :: held 1.704s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:33 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-a2179db8-bb82-4379-95c7-a1bdfe173c91 tempest-VolumesSnapshotTestJSON-1565575080 None] Created reservations ['dafda774-1b48-4ca8-9157-cc44238d0b9f', '7121cf5d-2130-468e-b582-9c3183d67918', '36a89f76-1f66-4ec7-812a-3f66900fe039', 'f90c7cb8-dae1-43b2-b65a-5217a8d8550d'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:36:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a2179db8-bb82-4379-95c7-a1bdfe173c91 tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a2179db8-bb82-4379-95c7-a1bdfe173c91 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:33 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a2179db8-bb82-4379-95c7-a1bdfe173c91 tempest-VolumesSnapshotTestJSON-1565575080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:33 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a2179db8-bb82-4379-95c7-a1bdfe173c91 tempest-VolumesSnapshotTestJSON-1565575080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a2179db8-bb82-4379-95c7-a1bdfe173c91 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a2179db8-bb82-4379-95c7-a1bdfe173c91 tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:33 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:36:33 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e5c4828f-22a1-4b7a-bb1c-1921e6c5194f tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "cinder-c09bf827-c7c4-4aca-96d6-e79ce0f380bc-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e5c4828f-22a1-4b7a-bb1c-1921e6c5194f tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-c09bf827-c7c4-4aca-96d6-e79ce0f380bc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e5c4828f-22a1-4b7a-bb1c-1921e6c5194f tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "cinder-quobyte-c09bf827-c7c4-4aca-96d6-e79ce0f380bc" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:36:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e5c4828f-22a1-4b7a-bb1c-1921e6c5194f tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-c09bf827-c7c4-4aca-96d6-e79ce0f380bc" acquired by "delete_volume" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:36:34 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3d7e37-d4e8-4169-b4f9-415616f368d3]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:36:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e5c4828f-22a1-4b7a-bb1c-1921e6c5194f tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:34 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc Jul 07 17:36:34 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:34 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a2179db8-bb82-4379-95c7-a1bdfe173c91 tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.823s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:34 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-a2179db8-bb82-4379-95c7-a1bdfe173c91 tempest-VolumesSnapshotTestJSON-1565575080 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:36:34 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-a2179db8-bb82-4379-95c7-a1bdfe173c91 tempest-VolumesSnapshotTestJSON-1565575080 None] Deleted volume successfully. Jul 07 17:36:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a2179db8-bb82-4379-95c7-a1bdfe173c91 tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-be50149b-80d1-41d9-b388-62f04dfacbb9-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:35 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e5c4828f-22a1-4b7a-bb1c-1921e6c5194f tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc" returned: 0 in 0.978s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e5c4828f-22a1-4b7a-bb1c-1921e6c5194f tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:35 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc Jul 07 17:36:35 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:36 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e5c4828f-22a1-4b7a-bb1c-1921e6c5194f tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c09bf827-c7c4-4aca-96d6-e79ce0f380bc" returned: 0 in 0.775s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e5c4828f-22a1-4b7a-bb1c-1921e6c5194f tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-quobyte-c09bf827-c7c4-4aca-96d6-e79ce0f380bc" released by "delete_volume" :: held 1.838s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:36 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-e5c4828f-22a1-4b7a-bb1c-1921e6c5194f tempest-VolumesSnapshotTestJSON-1565575080 None] Created reservations ['6912fd1f-722c-4134-b4d2-ad75ce575e2a', '0f3047e9-115e-4b2a-9f95-18b0e1ec9c21', '68068317-8482-479f-aabc-9700fcb8f43e', 'dc3baad4-d086-437b-96a9-059223687ecf'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:36:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e5c4828f-22a1-4b7a-bb1c-1921e6c5194f tempest-VolumesSnapshotTestJSON-1565575080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e5c4828f-22a1-4b7a-bb1c-1921e6c5194f tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e5c4828f-22a1-4b7a-bb1c-1921e6c5194f tempest-VolumesSnapshotTestJSON-1565575080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e5c4828f-22a1-4b7a-bb1c-1921e6c5194f tempest-VolumesSnapshotTestJSON-1565575080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e5c4828f-22a1-4b7a-bb1c-1921e6c5194f tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e5c4828f-22a1-4b7a-bb1c-1921e6c5194f tempest-VolumesSnapshotTestJSON-1565575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:36 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:36:36 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:36 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e5c4828f-22a1-4b7a-bb1c-1921e6c5194f tempest-VolumesSnapshotTestJSON-1565575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.779s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:36 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-e5c4828f-22a1-4b7a-bb1c-1921e6c5194f tempest-VolumesSnapshotTestJSON-1565575080 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:36:37 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-e5c4828f-22a1-4b7a-bb1c-1921e6c5194f tempest-VolumesSnapshotTestJSON-1565575080 None] Deleted volume successfully. Jul 07 17:36:37 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e5c4828f-22a1-4b7a-bb1c-1921e6c5194f tempest-VolumesSnapshotTestJSON-1565575080 None] Lock "cinder-c09bf827-c7c4-4aca-96d6-e79ce0f380bc-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:36:46 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=23,cinder:UPDATE=41,cinder:INSERT=12,cinder:DELETE=2 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:36:47 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:UPDATE=79,cinder:SELECT=77,cinder:DELETE=8,cinder:INSERT=19 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:36:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:36:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:36:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:36:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:36:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:36:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:36:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:36:56 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:36:56 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:36:57 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Jul 07 17:36:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.885s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:36:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:36:57 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:36:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:36:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:37:10 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:37:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Flow 'volume_create_manager' (32c6aa57-8542-4b80-a097-e99351e84014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:37:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13774192-05d6-436a-bd41-2ca9539295bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13774192-05d6-436a-bd41-2ca9539295bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-927295918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed8cc283-ff52-4a9d-8a6f-d166b15226df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20a6ff6edb1442358fc80a25513bc6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:37:10Z,use_quota=True,user_id='0461fbc7db694464929beca398c10834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f2f2dd-b309-4d7a-8d0a-f37491a2814b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f2f2dd-b309-4d7a-8d0a-f37491a2814b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ba41ca3-43ee-424a-aa9d-8d8fba00772a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ba41ca3-43ee-424a-aa9d-8d8fba00772a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed8cc283-ff52-4a9d-8a6f-d166b15226df', 'volume_name': 'volume-ed8cc283-ff52-4a9d-8a6f-d166b15226df', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c0589b-ef18-4724-b797-9219d7734548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c0589b-ef18-4724-b797-9219d7734548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d4a989-cbe8-4ab5-813d-cdf6ecf202f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:10 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Volume ed8cc283-ff52-4a9d-8a6f-d166b15226df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed8cc283-ff52-4a9d-8a6f-d166b15226df', 'volume_size': 1} Jul 07 17:37:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-927295918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed8cc283-ff52-4a9d-8a6f-d166b15226df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20a6ff6edb1442358fc80a25513bc6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:37:10Z,use_quota=True,user_id='0461fbc7db694464929beca398c10834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:37:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Creating volume ed8cc283-ff52-4a9d-8a6f-d166b15226df {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:37:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:37:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:37:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:37:10 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:37:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ed8cc283-ff52-4a9d-8a6f-d166b15226df 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:10 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ed8cc283-ff52-4a9d-8a6f-d166b15226df 1073741824 Jul 07 17:37:10 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:11 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:37:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Flow 'volume_create_manager' (f06cdefb-203d-4c29-a062-51549b41d920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:37:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9afa4e20-dd0a-40b9-854f-39518c0ac0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9afa4e20-dd0a-40b9-854f-39518c0ac0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-646768606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb746e8e-d940-4caa-8bc4-a4542bb364fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20a6ff6edb1442358fc80a25513bc6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:37:11Z,use_quota=True,user_id='0461fbc7db694464929beca398c10834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e784a1-0673-4d2e-a308-4660f2cf339f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e784a1-0673-4d2e-a308-4660f2cf339f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22654e3b-1c7e-4996-bfe7-8bc556d03581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22654e3b-1c7e-4996-bfe7-8bc556d03581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb746e8e-d940-4caa-8bc4-a4542bb364fc', 'volume_name': 'volume-bb746e8e-d940-4caa-8bc4-a4542bb364fc', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91c32d0-1665-46c8-9348-ebe9732398e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91c32d0-1665-46c8-9348-ebe9732398e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7c5639-6783-4b6d-9712-83d0cfd989df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:11 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Volume bb746e8e-d940-4caa-8bc4-a4542bb364fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb746e8e-d940-4caa-8bc4-a4542bb364fc', 'volume_size': 1} Jul 07 17:37:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:12 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ed8cc283-ff52-4a9d-8a6f-d166b15226df 1073741824" returned: 0 in 1.680s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ed8cc283-ff52-4a9d-8a6f-d166b15226df {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:12 devstack sudo[103089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ed8cc283-ff52-4a9d-8a6f-d166b15226df Jul 07 17:37:12 devstack sudo[103089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:13 devstack sudo[103089]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ed8cc283-ff52-4a9d-8a6f-d166b15226df" returned: 0 in 0.792s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] <== create_volume: return (2580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:37:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.583s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.948s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-646768606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb746e8e-d940-4caa-8bc4-a4542bb364fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20a6ff6edb1442358fc80a25513bc6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:37:11Z,use_quota=True,user_id='0461fbc7db694464929beca398c10834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:37:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Creating volume bb746e8e-d940-4caa-8bc4-a4542bb364fc {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:37:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:37:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:37:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:37:13 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:37:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bb746e8e-d940-4caa-8bc4-a4542bb364fc 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d4a989-cbe8-4ab5-813d-cdf6ecf202f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed8cc283-ff52-4a9d-8a6f-d166b15226df', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:13 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bb746e8e-d940-4caa-8bc4-a4542bb364fc 1073741824 Jul 07 17:37:13 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5738d87-61d8-4376-a6e0-3f872cb59c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:13 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Volume volume-ed8cc283-ff52-4a9d-8a6f-d166b15226df (ed8cc283-ff52-4a9d-8a6f-d166b15226df): created successfully Jul 07 17:37:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5738d87-61d8-4376-a6e0-3f872cb59c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Flow 'volume_create_manager' (32c6aa57-8542-4b80-a097-e99351e84014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:37:13 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-d6939f3b-4db9-4edd-a560-dba76c455b3a tempest-TestServerVolumeAttachmentScenario-1713113196 None] Created volume successfully. Jul 07 17:37:14 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bb746e8e-d940-4caa-8bc4-a4542bb364fc 1073741824" returned: 0 in 1.073s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bb746e8e-d940-4caa-8bc4-a4542bb364fc {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:14 devstack sudo[103117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bb746e8e-d940-4caa-8bc4-a4542bb364fc Jul 07 17:37:14 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:15 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bb746e8e-d940-4caa-8bc4-a4542bb364fc" returned: 0 in 0.846s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:37:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.977s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7c5639-6783-4b6d-9712-83d0cfd989df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb746e8e-d940-4caa-8bc4-a4542bb364fc', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ef2b1a-c0e0-47fb-bdcd-00e088389b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:15 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Volume volume-bb746e8e-d940-4caa-8bc4-a4542bb364fc (bb746e8e-d940-4caa-8bc4-a4542bb364fc): created successfully Jul 07 17:37:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ef2b1a-c0e0-47fb-bdcd-00e088389b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Flow 'volume_create_manager' (f06cdefb-203d-4c29-a062-51549b41d920) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:37:15 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-388648b6-889b-4b66-97bf-94ee73cc97b7 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Created volume successfully. Jul 07 17:37:23 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:37:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Flow 'volume_create_manager' (a21933c1-2186-4cdd-b43c-c5cd572ca5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:37:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a119d903-cad6-4a8c-bcaf-7e3bf98a53b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a119d903-cad6-4a8c-bcaf-7e3bf98a53b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-663715574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83eb3b4f-bf74-4279-8921-8545a5472ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b114572a18164dd4bec9309d68669f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:37:23Z,use_quota=True,user_id='1199937e12714568a11523be5b149ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd6fa33-e204-4211-bdc0-aec25397730a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd6fa33-e204-4211-bdc0-aec25397730a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186bad0c-dfeb-4c56-ac2e-eff5e0f4fcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186bad0c-dfeb-4c56-ac2e-eff5e0f4fcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83eb3b4f-bf74-4279-8921-8545a5472ac6', 'volume_name': 'volume-83eb3b4f-bf74-4279-8921-8545a5472ac6', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0edf58a-abaa-4ad6-ad49-fc46d6913b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0edf58a-abaa-4ad6-ad49-fc46d6913b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47cc5552-06ac-4656-966c-862ee109aa2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:23 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Volume 83eb3b4f-bf74-4279-8921-8545a5472ac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83eb3b4f-bf74-4279-8921-8545a5472ac6', 'volume_size': 1} Jul 07 17:37:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:23 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-663715574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83eb3b4f-bf74-4279-8921-8545a5472ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b114572a18164dd4bec9309d68669f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:37:23Z,use_quota=True,user_id='1199937e12714568a11523be5b149ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:37:23 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Creating volume 83eb3b4f-bf74-4279-8921-8545a5472ac6 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:37:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:23 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:37:23 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:37:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:23 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:37:23 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:37:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-83eb3b4f-bf74-4279-8921-8545a5472ac6 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:23 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-83eb3b4f-bf74-4279-8921-8545a5472ac6 1073741824 Jul 07 17:37:23 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:24 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-83eb3b4f-bf74-4279-8921-8545a5472ac6 1073741824" returned: 0 in 1.095s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-83eb3b4f-bf74-4279-8921-8545a5472ac6 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:24 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-83eb3b4f-bf74-4279-8921-8545a5472ac6 Jul 07 17:37:24 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:25 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-83eb3b4f-bf74-4279-8921-8545a5472ac6" returned: 0 in 0.891s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:37:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47cc5552-06ac-4656-966c-862ee109aa2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83eb3b4f-bf74-4279-8921-8545a5472ac6', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2995e93-6cc5-451f-b75c-abbe5eb67e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:37:25 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Volume volume-83eb3b4f-bf74-4279-8921-8545a5472ac6 (83eb3b4f-bf74-4279-8921-8545a5472ac6): created successfully Jul 07 17:37:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2995e93-6cc5-451f-b75c-abbe5eb67e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:37:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Flow 'volume_create_manager' (a21933c1-2186-4cdd-b43c-c5cd572ca5c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:37:25 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-6e03f837-bbc8-407c-8adb-18fc394f3f47 tempest-TestMinimumBasicScenario-1276367729 None] Created volume successfully. Jul 07 17:37:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-6d993cae-33c9-46a8-aca6-6b62dcf941b7 req-7e094871-d4ad-4867-b45f-5c6dcdd2de46 tempest-TestMinimumBasicScenario-1276367729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-6d993cae-33c9-46a8-aca6-6b62dcf941b7 req-7e094871-d4ad-4867-b45f-5c6dcdd2de46 tempest-TestMinimumBasicScenario-1276367729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:30 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[679c24d9-fa03-41c7-bd5f-920ad08f3f7c]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-6d993cae-33c9-46a8-aca6-6b62dcf941b7 req-7e094871-d4ad-4867-b45f-5c6dcdd2de46 tempest-TestMinimumBasicScenario-1276367729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-83eb3b4f-bf74-4279-8921-8545a5472ac6 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:30 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-83eb3b4f-bf74-4279-8921-8545a5472ac6 Jul 07 17:37:30 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:32 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-6d993cae-33c9-46a8-aca6-6b62dcf941b7 req-7e094871-d4ad-4867-b45f-5c6dcdd2de46 tempest-TestMinimumBasicScenario-1276367729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-83eb3b4f-bf74-4279-8921-8545a5472ac6" returned: 0 in 1.447s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-6d993cae-33c9-46a8-aca6-6b62dcf941b7 req-7e094871-d4ad-4867-b45f-5c6dcdd2de46 tempest-TestMinimumBasicScenario-1276367729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.484s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-6d993cae-33c9-46a8-aca6-6b62dcf941b7 req-7e094871-d4ad-4867-b45f-5c6dcdd2de46 tempest-TestMinimumBasicScenario-1276367729 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2', 'name': 'volume-83eb3b4f-bf74-4279-8921-8545a5472ac6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '33b17356-4a31-4bd4-b06f-1e9fc9126458', 'enforce_multipath': True} {{(pid=87303) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:37:32 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-6d993cae-33c9-46a8-aca6-6b62dcf941b7 req-7e094871-d4ad-4867-b45f-5c6dcdd2de46 tempest-TestMinimumBasicScenario-1276367729 None] attachment_update completed successfully. Jul 07 17:37:42 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=13,cinder:UPDATE=12 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:37:42 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:UPDATE=9,cinder:SELECT=10,cinder:INSERT=3,cinder:DELETE=3 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:37:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:37:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:37:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:37:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:56 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:37:56 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-71c3ed9e-ab8a-4843-b39d-cead2164855c req-1de785f9-24ef-4010-9702-8a5a36a9f56e tempest-TestServerVolumeAttachmentScenario-1713113196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:37:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-71c3ed9e-ab8a-4843-b39d-cead2164855c req-1de785f9-24ef-4010-9702-8a5a36a9f56e tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:37:57 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb44bdd-eecb-4120-a3b2-20f7f20d3cb6]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:37:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-71c3ed9e-ab8a-4843-b39d-cead2164855c req-1de785f9-24ef-4010-9702-8a5a36a9f56e tempest-TestServerVolumeAttachmentScenario-1713113196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ed8cc283-ff52-4a9d-8a6f-d166b15226df {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:37:57 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ed8cc283-ff52-4a9d-8a6f-d166b15226df Jul 07 17:37:57 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:37:57 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.924s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:37:57 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:37:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:37:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:37:58 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Jul 07 17:37:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-71c3ed9e-ab8a-4843-b39d-cead2164855c req-1de785f9-24ef-4010-9702-8a5a36a9f56e tempest-TestServerVolumeAttachmentScenario-1713113196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ed8cc283-ff52-4a9d-8a6f-d166b15226df" returned: 0 in 0.996s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:37:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-71c3ed9e-ab8a-4843-b39d-cead2164855c req-1de785f9-24ef-4010-9702-8a5a36a9f56e tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.032s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:37:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-71c3ed9e-ab8a-4843-b39d-cead2164855c req-1de785f9-24ef-4010-9702-8a5a36a9f56e tempest-TestServerVolumeAttachmentScenario-1713113196 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2', 'name': 'volume-ed8cc283-ff52-4a9d-8a6f-d166b15226df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '297f0ed3-bc65-4808-a667-dfb29a3c00e3', 'enforce_multipath': True} {{(pid=87303) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:37:58 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-71c3ed9e-ab8a-4843-b39d-cead2164855c req-1de785f9-24ef-4010-9702-8a5a36a9f56e tempest-TestServerVolumeAttachmentScenario-1713113196 None] attachment_update completed successfully. Jul 07 17:38:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-55bdb44b-a76d-4676-8d94-4b2d453ade40 req-526d2eeb-2ee6-4309-b203-599b0e4aad7d tempest-TestServerVolumeAttachmentScenario-1713113196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-55bdb44b-a76d-4676-8d94-4b2d453ade40 req-526d2eeb-2ee6-4309-b203-599b0e4aad7d tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:08 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09d0c41-f556-4264-a749-22a0f06c7046]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:38:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-55bdb44b-a76d-4676-8d94-4b2d453ade40 req-526d2eeb-2ee6-4309-b203-599b0e4aad7d tempest-TestServerVolumeAttachmentScenario-1713113196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bb746e8e-d940-4caa-8bc4-a4542bb364fc {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:09 devstack sudo[103880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bb746e8e-d940-4caa-8bc4-a4542bb364fc Jul 07 17:38:09 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:09 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-55bdb44b-a76d-4676-8d94-4b2d453ade40 req-526d2eeb-2ee6-4309-b203-599b0e4aad7d tempest-TestServerVolumeAttachmentScenario-1713113196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bb746e8e-d940-4caa-8bc4-a4542bb364fc" returned: 0 in 0.997s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-55bdb44b-a76d-4676-8d94-4b2d453ade40 req-526d2eeb-2ee6-4309-b203-599b0e4aad7d tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.028s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-55bdb44b-a76d-4676-8d94-4b2d453ade40 req-526d2eeb-2ee6-4309-b203-599b0e4aad7d tempest-TestServerVolumeAttachmentScenario-1713113196 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2', 'name': 'volume-bb746e8e-d940-4caa-8bc4-a4542bb364fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51c621c2-bdbe-49f0-ab47-9afadbcc1181', 'enforce_multipath': True} {{(pid=87303) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:38:10 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-55bdb44b-a76d-4676-8d94-4b2d453ade40 req-526d2eeb-2ee6-4309-b203-599b0e4aad7d tempest-TestServerVolumeAttachmentScenario-1713113196 None] attachment_update completed successfully. Jul 07 17:38:16 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-15611bb8-5416-44a5-9a7b-789dc44524a1 req-5d828978-2087-4ab9-a039-c810a34fc5bf tempest-TestServerVolumeAttachmentScenario-1713113196 None] Terminate volume connection completed successfully. Jul 07 17:38:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-15611bb8-5416-44a5-9a7b-789dc44524a1 req-5d828978-2087-4ab9-a039-c810a34fc5bf tempest-TestServerVolumeAttachmentScenario-1713113196 None] Deleting attachment 51c621c2-bdbe-49f0-ab47-9afadbcc1181. {{(pid=87303) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:38:20 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-f5a9562c-4ba2-40d3-8f4c-321358982904 req-95383901-5f5f-4c25-89e0-437b950e34f4 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Terminate volume connection completed successfully. Jul 07 17:38:20 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-f5a9562c-4ba2-40d3-8f4c-321358982904 req-95383901-5f5f-4c25-89e0-437b950e34f4 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Deleting attachment 297f0ed3-bc65-4808-a667-dfb29a3c00e3. {{(pid=87303) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:38:23 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-7848fa3a-2037-48d6-be6e-fe67f55ffb05 req-561b61c7-a81a-4c1d-b3ba-2421867bab0e tempest-TestMinimumBasicScenario-1276367729 None] Terminate volume connection completed successfully. Jul 07 17:38:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-7848fa3a-2037-48d6-be6e-fe67f55ffb05 req-561b61c7-a81a-4c1d-b3ba-2421867bab0e tempest-TestMinimumBasicScenario-1276367729 None] Deleting attachment 33b17356-4a31-4bd4-b06f-1e9fc9126458. {{(pid=87303) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:38:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-10557e19-0153-403f-a62d-e0153bd0ddc4 tempest-TestMinimumBasicScenario-1276367729 None] Acquiring lock "cinder-83eb3b4f-bf74-4279-8921-8545a5472ac6-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:38:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-10557e19-0153-403f-a62d-e0153bd0ddc4 tempest-TestMinimumBasicScenario-1276367729 None] Lock "cinder-83eb3b4f-bf74-4279-8921-8545a5472ac6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:38:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-10557e19-0153-403f-a62d-e0153bd0ddc4 tempest-TestMinimumBasicScenario-1276367729 None] Acquiring lock "cinder-quobyte-83eb3b4f-bf74-4279-8921-8545a5472ac6" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:38:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-10557e19-0153-403f-a62d-e0153bd0ddc4 tempest-TestMinimumBasicScenario-1276367729 None] Lock "cinder-quobyte-83eb3b4f-bf74-4279-8921-8545a5472ac6" acquired by "delete_volume" :: waited 0.024s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:38:25 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9092dd-55c8-41d3-a2dc-fe82d8e40cd9]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:38:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-10557e19-0153-403f-a62d-e0153bd0ddc4 tempest-TestMinimumBasicScenario-1276367729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-83eb3b4f-bf74-4279-8921-8545a5472ac6 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:25 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-83eb3b4f-bf74-4279-8921-8545a5472ac6 Jul 07 17:38:25 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:26 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-10557e19-0153-403f-a62d-e0153bd0ddc4 tempest-TestMinimumBasicScenario-1276367729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-83eb3b4f-bf74-4279-8921-8545a5472ac6" returned: 0 in 0.928s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-10557e19-0153-403f-a62d-e0153bd0ddc4 tempest-TestMinimumBasicScenario-1276367729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-83eb3b4f-bf74-4279-8921-8545a5472ac6 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:26 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-83eb3b4f-bf74-4279-8921-8545a5472ac6 Jul 07 17:38:26 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:27 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-10557e19-0153-403f-a62d-e0153bd0ddc4 tempest-TestMinimumBasicScenario-1276367729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-83eb3b4f-bf74-4279-8921-8545a5472ac6" returned: 0 in 0.740s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-10557e19-0153-403f-a62d-e0153bd0ddc4 tempest-TestMinimumBasicScenario-1276367729 None] Lock "cinder-quobyte-83eb3b4f-bf74-4279-8921-8545a5472ac6" released by "delete_volume" :: held 1.737s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:38:27 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-10557e19-0153-403f-a62d-e0153bd0ddc4 tempest-TestMinimumBasicScenario-1276367729 None] Created reservations ['8211b1d9-01cc-4239-861f-7da194e5e56a', '0db456af-bc0f-4dba-b6a6-6bb99ec2e7b8', '5c7fea64-0899-4dd9-85e6-444e55ecef26', '4d9e0604-036f-4fdf-ae68-da83f94581ea'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:38:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-10557e19-0153-403f-a62d-e0153bd0ddc4 tempest-TestMinimumBasicScenario-1276367729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-10557e19-0153-403f-a62d-e0153bd0ddc4 tempest-TestMinimumBasicScenario-1276367729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-10557e19-0153-403f-a62d-e0153bd0ddc4 tempest-TestMinimumBasicScenario-1276367729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:38:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-10557e19-0153-403f-a62d-e0153bd0ddc4 tempest-TestMinimumBasicScenario-1276367729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:38:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-10557e19-0153-403f-a62d-e0153bd0ddc4 tempest-TestMinimumBasicScenario-1276367729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-10557e19-0153-403f-a62d-e0153bd0ddc4 tempest-TestMinimumBasicScenario-1276367729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:27 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:38:27 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:28 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-10557e19-0153-403f-a62d-e0153bd0ddc4 tempest-TestMinimumBasicScenario-1276367729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.807s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:28 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-10557e19-0153-403f-a62d-e0153bd0ddc4 tempest-TestMinimumBasicScenario-1276367729 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:38:28 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-10557e19-0153-403f-a62d-e0153bd0ddc4 tempest-TestMinimumBasicScenario-1276367729 None] Deleted volume successfully. Jul 07 17:38:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-10557e19-0153-403f-a62d-e0153bd0ddc4 tempest-TestMinimumBasicScenario-1276367729 None] Lock "cinder-83eb3b4f-bf74-4279-8921-8545a5472ac6-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:38:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d1ffa1b7-0ebd-47a0-9618-f5a7a401e292 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Acquiring lock "cinder-bb746e8e-d940-4caa-8bc4-a4542bb364fc-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:38:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d1ffa1b7-0ebd-47a0-9618-f5a7a401e292 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "cinder-bb746e8e-d940-4caa-8bc4-a4542bb364fc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:38:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d1ffa1b7-0ebd-47a0-9618-f5a7a401e292 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Acquiring lock "cinder-quobyte-bb746e8e-d940-4caa-8bc4-a4542bb364fc" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:38:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d1ffa1b7-0ebd-47a0-9618-f5a7a401e292 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "cinder-quobyte-bb746e8e-d940-4caa-8bc4-a4542bb364fc" acquired by "delete_volume" :: waited 0.018s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:38:31 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[6126c098-c327-413a-8ddd-7cfb44a66b03]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:38:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d1ffa1b7-0ebd-47a0-9618-f5a7a401e292 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bb746e8e-d940-4caa-8bc4-a4542bb364fc {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:31 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bb746e8e-d940-4caa-8bc4-a4542bb364fc Jul 07 17:38:31 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:32 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d1ffa1b7-0ebd-47a0-9618-f5a7a401e292 tempest-TestServerVolumeAttachmentScenario-1713113196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bb746e8e-d940-4caa-8bc4-a4542bb364fc" returned: 0 in 0.808s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d1ffa1b7-0ebd-47a0-9618-f5a7a401e292 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bb746e8e-d940-4caa-8bc4-a4542bb364fc {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:32 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bb746e8e-d940-4caa-8bc4-a4542bb364fc Jul 07 17:38:32 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:33 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d1ffa1b7-0ebd-47a0-9618-f5a7a401e292 tempest-TestServerVolumeAttachmentScenario-1713113196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bb746e8e-d940-4caa-8bc4-a4542bb364fc" returned: 0 in 0.763s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d1ffa1b7-0ebd-47a0-9618-f5a7a401e292 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "cinder-quobyte-bb746e8e-d940-4caa-8bc4-a4542bb364fc" released by "delete_volume" :: held 1.621s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:38:33 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-d1ffa1b7-0ebd-47a0-9618-f5a7a401e292 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Created reservations ['3501059e-5524-42a5-a941-5a1ed57cf8cc', 'db06bc2d-0712-4d2f-800a-bfebc4ffc598', '3d38e4ee-8c52-4744-b230-a9134ecd34c8', '45aeae9f-4ee2-4630-a096-b5576ba36afb'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:38:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d1ffa1b7-0ebd-47a0-9618-f5a7a401e292 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d1ffa1b7-0ebd-47a0-9618-f5a7a401e292 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:33 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d1ffa1b7-0ebd-47a0-9618-f5a7a401e292 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:38:33 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d1ffa1b7-0ebd-47a0-9618-f5a7a401e292 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:38:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d1ffa1b7-0ebd-47a0-9618-f5a7a401e292 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d1ffa1b7-0ebd-47a0-9618-f5a7a401e292 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:33 devstack sudo[103993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:38:33 devstack sudo[103993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-aed964cf-317e-4715-8c10-972425965785 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Acquiring lock "cinder-ed8cc283-ff52-4a9d-8a6f-d166b15226df-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:38:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-aed964cf-317e-4715-8c10-972425965785 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "cinder-ed8cc283-ff52-4a9d-8a6f-d166b15226df-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:38:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-aed964cf-317e-4715-8c10-972425965785 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Acquiring lock "cinder-quobyte-ed8cc283-ff52-4a9d-8a6f-d166b15226df" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:38:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-aed964cf-317e-4715-8c10-972425965785 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "cinder-quobyte-ed8cc283-ff52-4a9d-8a6f-d166b15226df" acquired by "delete_volume" :: waited 0.020s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:38:33 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d201d610-3f62-40aa-b79b-aa4d430d5b3a]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:38:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aed964cf-317e-4715-8c10-972425965785 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ed8cc283-ff52-4a9d-8a6f-d166b15226df {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:34 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ed8cc283-ff52-4a9d-8a6f-d166b15226df Jul 07 17:38:34 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:34 devstack sudo[103993]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d1ffa1b7-0ebd-47a0-9618-f5a7a401e292 tempest-TestServerVolumeAttachmentScenario-1713113196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.762s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:34 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-d1ffa1b7-0ebd-47a0-9618-f5a7a401e292 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:38:34 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-d1ffa1b7-0ebd-47a0-9618-f5a7a401e292 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Deleted volume successfully. Jul 07 17:38:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d1ffa1b7-0ebd-47a0-9618-f5a7a401e292 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "cinder-bb746e8e-d940-4caa-8bc4-a4542bb364fc-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:38:34 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aed964cf-317e-4715-8c10-972425965785 tempest-TestServerVolumeAttachmentScenario-1713113196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ed8cc283-ff52-4a9d-8a6f-d166b15226df" returned: 0 in 0.841s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aed964cf-317e-4715-8c10-972425965785 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ed8cc283-ff52-4a9d-8a6f-d166b15226df {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:34 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ed8cc283-ff52-4a9d-8a6f-d166b15226df Jul 07 17:38:34 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:35 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aed964cf-317e-4715-8c10-972425965785 tempest-TestServerVolumeAttachmentScenario-1713113196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ed8cc283-ff52-4a9d-8a6f-d166b15226df" returned: 0 in 0.688s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-aed964cf-317e-4715-8c10-972425965785 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "cinder-quobyte-ed8cc283-ff52-4a9d-8a6f-d166b15226df" released by "delete_volume" :: held 1.579s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:38:35 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-aed964cf-317e-4715-8c10-972425965785 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Created reservations ['396786c7-74a8-4da6-a3c3-5c1455823f34', 'a5c6c311-9b7d-478e-826f-b433b349cf78', 'ab0d33bf-9525-45f8-8ce3-7fe8cb20fd0f', '733c22de-a1e1-4c90-8556-8892c84a889f'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:38:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aed964cf-317e-4715-8c10-972425965785 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aed964cf-317e-4715-8c10-972425965785 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:35 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aed964cf-317e-4715-8c10-972425965785 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:38:35 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-aed964cf-317e-4715-8c10-972425965785 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:38:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-aed964cf-317e-4715-8c10-972425965785 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aed964cf-317e-4715-8c10-972425965785 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:35 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:38:35 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:36 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-aed964cf-317e-4715-8c10-972425965785 tempest-TestServerVolumeAttachmentScenario-1713113196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.730s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:36 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-aed964cf-317e-4715-8c10-972425965785 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:38:36 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-aed964cf-317e-4715-8c10-972425965785 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Deleted volume successfully. Jul 07 17:38:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-aed964cf-317e-4715-8c10-972425965785 tempest-TestServerVolumeAttachmentScenario-1713113196 None] Lock "cinder-ed8cc283-ff52-4a9d-8a6f-d166b15226df-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:38:45 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=26,cinder:UPDATE=31,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:38:46 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=33,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:38:48 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:38:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Flow 'volume_create_manager' (506961e7-db43-4b43-9c7d-707f8ec54233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:38:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9074062e-b36c-4c03-844f-315d1f521dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9074062e-b36c-4c03-844f-315d1f521dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-424745527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd34ccd8-1944-4396-ab75-544269b6e07c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3404b2210784766b6905c8dae4ff3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:38:49Z,use_quota=True,user_id='ca6a0ace75ae4e0ea5e759d2fccc03b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1c6e5f-1269-4186-8859-78720e794412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1c6e5f-1269-4186-8859-78720e794412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db33ee84-7f20-44cd-be9e-797999fa929a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db33ee84-7f20-44cd-be9e-797999fa929a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd34ccd8-1944-4396-ab75-544269b6e07c', 'volume_name': 'volume-cd34ccd8-1944-4396-ab75-544269b6e07c', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11242120-c591-4ddb-820c-77e1c9d7ec4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:48 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11242120-c591-4ddb-820c-77e1c9d7ec4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eac67b1-0bc9-41fe-afe1-a4f761b26763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:49 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Volume cd34ccd8-1944-4396-ab75-544269b6e07c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd34ccd8-1944-4396-ab75-544269b6e07c', 'volume_size': 1} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-424745527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd34ccd8-1944-4396-ab75-544269b6e07c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3404b2210784766b6905c8dae4ff3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:38:49Z,use_quota=True,user_id='ca6a0ace75ae4e0ea5e759d2fccc03b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Creating volume cd34ccd8-1944-4396-ab75-544269b6e07c {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:38:49 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cd34ccd8-1944-4396-ab75-544269b6e07c 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:49 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cd34ccd8-1944-4396-ab75-544269b6e07c 1073741824 Jul 07 17:38:49 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Flow 'volume_create_manager' (d0dccdfc-a27a-4cac-b450-ef98198fe714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ceb515a-199b-4191-b275-660b52362d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ceb515a-199b-4191-b275-660b52362d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1705186613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330e8db8-7dda-4afc-9645-429e8c2b8233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3404b2210784766b6905c8dae4ff3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:38:49Z,use_quota=True,user_id='ca6a0ace75ae4e0ea5e759d2fccc03b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5c14605-9096-46d5-b08f-6f7fd83d8d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5c14605-9096-46d5-b08f-6f7fd83d8d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f0965a-bc38-4711-a69c-b5da108b632c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f0965a-bc38-4711-a69c-b5da108b632c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '330e8db8-7dda-4afc-9645-429e8c2b8233', 'volume_name': 'volume-330e8db8-7dda-4afc-9645-429e8c2b8233', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaae4d63-ab1c-4147-b198-1f4821f14002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaae4d63-ab1c-4147-b198-1f4821f14002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e61a0ca-a679-448c-901e-915b167d2e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:49 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Volume 330e8db8-7dda-4afc-9645-429e8c2b8233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-330e8db8-7dda-4afc-9645-429e8c2b8233', 'volume_size': 1} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Flow 'volume_create_manager' (6ab3a059-af4d-4df8-9871-bfbe0fb09935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9cfab8-6def-4ffa-956b-6937b2c86dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9cfab8-6def-4ffa-956b-6937b2c86dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-59862480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92a8ac8-a3b8-43e1-8c2d-2bb191a50312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3404b2210784766b6905c8dae4ff3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:38:50Z,use_quota=True,user_id='ca6a0ace75ae4e0ea5e759d2fccc03b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad29240d-20fd-4c60-884e-4e67d38b16b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad29240d-20fd-4c60-884e-4e67d38b16b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a2eb358-37ae-44ce-91cf-5b13be6441bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a2eb358-37ae-44ce-91cf-5b13be6441bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a92a8ac8-a3b8-43e1-8c2d-2bb191a50312', 'volume_name': 'volume-a92a8ac8-a3b8-43e1-8c2d-2bb191a50312', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9ffe7f-760a-4681-ae05-9f77bd8e50a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9ffe7f-760a-4681-ae05-9f77bd8e50a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c3fe13-b3ee-407c-ab3e-d1e7c6a46009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:50 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Volume a92a8ac8-a3b8-43e1-8c2d-2bb191a50312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a92a8ac8-a3b8-43e1-8c2d-2bb191a50312', 'volume_size': 1} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Flow 'volume_create_manager' (74a64a42-b1af-4c21-b30d-429560b7187a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e680b80-332a-4a53-b46a-c189d5cc1345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e680b80-332a-4a53-b46a-c189d5cc1345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2006664153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb4bb14-2ae0-4961-909b-196e638663c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3404b2210784766b6905c8dae4ff3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:38:50Z,use_quota=True,user_id='ca6a0ace75ae4e0ea5e759d2fccc03b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337920c1-7582-4b08-ae18-90f7d9f3f39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337920c1-7582-4b08-ae18-90f7d9f3f39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0981f7-5f14-4cd9-86cb-5dac8e0f7d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0981f7-5f14-4cd9-86cb-5dac8e0f7d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffb4bb14-2ae0-4961-909b-196e638663c3', 'volume_name': 'volume-ffb4bb14-2ae0-4961-909b-196e638663c3', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb7803a-6b03-4983-bb66-7ec788539ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb7803a-6b03-4983-bb66-7ec788539ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875e961a-f804-4ea3-8f30-cb85ec540937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:50 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Volume ffb4bb14-2ae0-4961-909b-196e638663c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffb4bb14-2ae0-4961-909b-196e638663c3', 'volume_size': 1} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:50 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cd34ccd8-1944-4396-ab75-544269b6e07c 1073741824" returned: 0 in 1.439s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cd34ccd8-1944-4396-ab75-544269b6e07c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:50 devstack sudo[104025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cd34ccd8-1944-4396-ab75-544269b6e07c Jul 07 17:38:50 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Flow 'volume_create_manager' (2ea3ddf4-d4b2-43ee-babc-dfdf89de505f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e001082-96ee-4556-9e3e-6fde209cf2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e001082-96ee-4556-9e3e-6fde209cf2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2060865672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c84c1534-a0e1-464d-8499-409204a4f8e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3404b2210784766b6905c8dae4ff3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:38:51Z,use_quota=True,user_id='ca6a0ace75ae4e0ea5e759d2fccc03b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0242f4-585f-4939-a7aa-fade91f5826c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0242f4-585f-4939-a7aa-fade91f5826c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7623ac-8c66-4f34-8567-134081bf1cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7623ac-8c66-4f34-8567-134081bf1cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c84c1534-a0e1-464d-8499-409204a4f8e7', 'volume_name': 'volume-c84c1534-a0e1-464d-8499-409204a4f8e7', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11c432a-dec3-459d-84dd-5da729a498b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11c432a-dec3-459d-84dd-5da729a498b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59eb656-207d-403e-9741-3d21d78697b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:50 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Volume c84c1534-a0e1-464d-8499-409204a4f8e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c84c1534-a0e1-464d-8499-409204a4f8e7', 'volume_size': 1} Jul 07 17:38:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:51 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cd34ccd8-1944-4396-ab75-544269b6e07c" returned: 0 in 0.833s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] <== create_volume: return (2325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:38:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.328s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.853s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1705186613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330e8db8-7dda-4afc-9645-429e8c2b8233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3404b2210784766b6905c8dae4ff3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:38:49Z,use_quota=True,user_id='ca6a0ace75ae4e0ea5e759d2fccc03b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:38:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Creating volume 330e8db8-7dda-4afc-9645-429e8c2b8233 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:38:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:38:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:38:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:38:51 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:38:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-330e8db8-7dda-4afc-9645-429e8c2b8233 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:51 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-330e8db8-7dda-4afc-9645-429e8c2b8233 1073741824 Jul 07 17:38:51 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:51 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eac67b1-0bc9-41fe-afe1-a4f761b26763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd34ccd8-1944-4396-ab75-544269b6e07c', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:51 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (563d960b-3ed2-481c-88ce-908e0e33509a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:51 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Volume volume-cd34ccd8-1944-4396-ab75-544269b6e07c (cd34ccd8-1944-4396-ab75-544269b6e07c): created successfully Jul 07 17:38:51 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (563d960b-3ed2-481c-88ce-908e0e33509a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:51 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Flow 'volume_create_manager' (506961e7-db43-4b43-9c7d-707f8ec54233) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:38:51 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-ba907f40-4ebd-42b5-a135-ec4128035db9 tempest-CreateVolumesFromImageTest-1864577864 None] Created volume successfully. Jul 07 17:38:52 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-330e8db8-7dda-4afc-9645-429e8c2b8233 1073741824" returned: 0 in 0.994s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-330e8db8-7dda-4afc-9645-429e8c2b8233 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:52 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-330e8db8-7dda-4afc-9645-429e8c2b8233 Jul 07 17:38:52 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:53 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-330e8db8-7dda-4afc-9645-429e8c2b8233" returned: 0 in 0.699s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:53 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:38:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.056s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:53 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-59862480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92a8ac8-a3b8-43e1-8c2d-2bb191a50312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3404b2210784766b6905c8dae4ff3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:38:50Z,use_quota=True,user_id='ca6a0ace75ae4e0ea5e759d2fccc03b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:38:53 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Creating volume a92a8ac8-a3b8-43e1-8c2d-2bb191a50312 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:38:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:53 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:38:53 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:38:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:53 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:38:53 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:38:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a92a8ac8-a3b8-43e1-8c2d-2bb191a50312 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e61a0ca-a679-448c-901e-915b167d2e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-330e8db8-7dda-4afc-9645-429e8c2b8233', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:53 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a92a8ac8-a3b8-43e1-8c2d-2bb191a50312 1073741824 Jul 07 17:38:53 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a43b7d-e1a2-4905-9dd1-c19efb3dbb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:53 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Volume volume-330e8db8-7dda-4afc-9645-429e8c2b8233 (330e8db8-7dda-4afc-9645-429e8c2b8233): created successfully Jul 07 17:38:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a43b7d-e1a2-4905-9dd1-c19efb3dbb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Flow 'volume_create_manager' (d0dccdfc-a27a-4cac-b450-ef98198fe714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:38:53 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-34a9dc1b-e114-48f5-b61d-83680b72c9eb tempest-CreateVolumesFromImageTest-1864577864 None] Created volume successfully. Jul 07 17:38:54 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a92a8ac8-a3b8-43e1-8c2d-2bb191a50312 1073741824" returned: 0 in 1.187s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a92a8ac8-a3b8-43e1-8c2d-2bb191a50312 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:54 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a92a8ac8-a3b8-43e1-8c2d-2bb191a50312 Jul 07 17:38:54 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:55 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a92a8ac8-a3b8-43e1-8c2d-2bb191a50312" returned: 0 in 0.749s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:55 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:38:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.715s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:55 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2006664153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb4bb14-2ae0-4961-909b-196e638663c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3404b2210784766b6905c8dae4ff3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:38:50Z,use_quota=True,user_id='ca6a0ace75ae4e0ea5e759d2fccc03b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:38:55 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Creating volume ffb4bb14-2ae0-4961-909b-196e638663c3 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:38:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:55 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:38:55 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:38:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:55 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:38:55 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:38:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ffb4bb14-2ae0-4961-909b-196e638663c3 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c3fe13-b3ee-407c-ab3e-d1e7c6a46009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a92a8ac8-a3b8-43e1-8c2d-2bb191a50312', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:55 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ffb4bb14-2ae0-4961-909b-196e638663c3 1073741824 Jul 07 17:38:55 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2717374-1077-42fd-8372-4d9062cb105f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:55 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Volume volume-a92a8ac8-a3b8-43e1-8c2d-2bb191a50312 (a92a8ac8-a3b8-43e1-8c2d-2bb191a50312): created successfully Jul 07 17:38:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2717374-1077-42fd-8372-4d9062cb105f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Flow 'volume_create_manager' (6ab3a059-af4d-4df8-9871-bfbe0fb09935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:38:55 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-8ab005ea-6151-4fd9-8959-a46cb1c3b221 tempest-CreateVolumesFromImageTest-1864577864 None] Created volume successfully. Jul 07 17:38:56 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ffb4bb14-2ae0-4961-909b-196e638663c3 1073741824" returned: 0 in 1.002s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ffb4bb14-2ae0-4961-909b-196e638663c3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:56 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ffb4bb14-2ae0-4961-909b-196e638663c3 Jul 07 17:38:56 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:38:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:38:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:38:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:56 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:38:56 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:57 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ffb4bb14-2ae0-4961-909b-196e638663c3" returned: 0 in 0.811s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:38:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.191s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2060865672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c84c1534-a0e1-464d-8499-409204a4f8e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3404b2210784766b6905c8dae4ff3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:38:51Z,use_quota=True,user_id='ca6a0ace75ae4e0ea5e759d2fccc03b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:38:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Creating volume c84c1534-a0e1-464d-8499-409204a4f8e7 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:38:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:38:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:38:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:38:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:38:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:38:57 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:38:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c84c1534-a0e1-464d-8499-409204a4f8e7 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875e961a-f804-4ea3-8f30-cb85ec540937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffb4bb14-2ae0-4961-909b-196e638663c3', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2324e57-969a-48f6-8cea-4a22258888d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:57 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c84c1534-a0e1-464d-8499-409204a4f8e7 1073741824 Jul 07 17:38:57 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:57 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Volume volume-ffb4bb14-2ae0-4961-909b-196e638663c3 (ffb4bb14-2ae0-4961-909b-196e638663c3): created successfully Jul 07 17:38:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2324e57-969a-48f6-8cea-4a22258888d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Flow 'volume_create_manager' (74a64a42-b1af-4c21-b30d-429560b7187a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:38:57 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-6c022b94-91a7-4fc9-9ba6-7e4b7ec4f85d tempest-CreateVolumesFromImageTest-1864577864 None] Created volume successfully. Jul 07 17:38:57 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.927s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:38:57 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:38:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:38:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:38:58 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c84c1534-a0e1-464d-8499-409204a4f8e7 1073741824" returned: 0 in 1.247s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c84c1534-a0e1-464d-8499-409204a4f8e7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:38:58 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c84c1534-a0e1-464d-8499-409204a4f8e7 Jul 07 17:38:58 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:38:59 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Jul 07 17:38:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c84c1534-a0e1-464d-8499-409204a4f8e7" returned: 0 in 0.767s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:38:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] <== create_volume: return (2064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:38:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.069s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:38:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59eb656-207d-403e-9741-3d21d78697b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c84c1534-a0e1-464d-8499-409204a4f8e7', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8f3f95-5161-4e5e-8601-c4d6fa538dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:38:59 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Volume volume-c84c1534-a0e1-464d-8499-409204a4f8e7 (c84c1534-a0e1-464d-8499-409204a4f8e7): created successfully Jul 07 17:38:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8f3f95-5161-4e5e-8601-c4d6fa538dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:38:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Flow 'volume_create_manager' (2ea3ddf4-d4b2-43ee-babc-dfdf89de505f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:38:59 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-c34bd221-82f8-4a8e-95f1-27620b0c4fa6 tempest-CreateVolumesFromImageTest-1864577864 None] Created volume successfully. Jul 07 17:38:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6975c469-ab13-4af2-95da-a148d52f06cf tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "cinder-c84c1534-a0e1-464d-8499-409204a4f8e7-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:38:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6975c469-ab13-4af2-95da-a148d52f06cf tempest-CreateVolumesFromImageTest-1864577864 None] Lock "cinder-c84c1534-a0e1-464d-8499-409204a4f8e7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:38:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6975c469-ab13-4af2-95da-a148d52f06cf tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "cinder-quobyte-c84c1534-a0e1-464d-8499-409204a4f8e7" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:38:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6975c469-ab13-4af2-95da-a148d52f06cf tempest-CreateVolumesFromImageTest-1864577864 None] Lock "cinder-quobyte-c84c1534-a0e1-464d-8499-409204a4f8e7" acquired by "delete_volume" :: waited 0.029s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:00 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9650faf-e317-45c3-975c-900c053ac13a]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6975c469-ab13-4af2-95da-a148d52f06cf tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c84c1534-a0e1-464d-8499-409204a4f8e7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:00 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c84c1534-a0e1-464d-8499-409204a4f8e7 Jul 07 17:39:00 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:00 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6975c469-ab13-4af2-95da-a148d52f06cf tempest-CreateVolumesFromImageTest-1864577864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c84c1534-a0e1-464d-8499-409204a4f8e7" returned: 0 in 0.932s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6975c469-ab13-4af2-95da-a148d52f06cf tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c84c1534-a0e1-464d-8499-409204a4f8e7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:00 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c84c1534-a0e1-464d-8499-409204a4f8e7 Jul 07 17:39:00 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:01 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6975c469-ab13-4af2-95da-a148d52f06cf tempest-CreateVolumesFromImageTest-1864577864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c84c1534-a0e1-464d-8499-409204a4f8e7" returned: 0 in 0.826s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6975c469-ab13-4af2-95da-a148d52f06cf tempest-CreateVolumesFromImageTest-1864577864 None] Lock "cinder-quobyte-c84c1534-a0e1-464d-8499-409204a4f8e7" released by "delete_volume" :: held 1.826s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:01 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-6975c469-ab13-4af2-95da-a148d52f06cf tempest-CreateVolumesFromImageTest-1864577864 None] Created reservations ['a107ee7a-c6cc-45d2-b795-88fd9eedae71', 'ea31c1a0-1b63-4b18-9246-9f934a500663', '0abd40e4-383b-4519-b3e9-d471f575901a', '9c074b1f-94f1-4011-be0c-5502dbe2b2c2'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:39:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6975c469-ab13-4af2-95da-a148d52f06cf tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6975c469-ab13-4af2-95da-a148d52f06cf tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6975c469-ab13-4af2-95da-a148d52f06cf tempest-CreateVolumesFromImageTest-1864577864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6975c469-ab13-4af2-95da-a148d52f06cf tempest-CreateVolumesFromImageTest-1864577864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6975c469-ab13-4af2-95da-a148d52f06cf tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6975c469-ab13-4af2-95da-a148d52f06cf tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:01 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:39:01 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-be5f4e73-4c5a-46c5-bfca-09782bd866ff tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "cinder-ffb4bb14-2ae0-4961-909b-196e638663c3-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-be5f4e73-4c5a-46c5-bfca-09782bd866ff tempest-CreateVolumesFromImageTest-1864577864 None] Lock "cinder-ffb4bb14-2ae0-4961-909b-196e638663c3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-be5f4e73-4c5a-46c5-bfca-09782bd866ff tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "cinder-quobyte-ffb4bb14-2ae0-4961-909b-196e638663c3" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-be5f4e73-4c5a-46c5-bfca-09782bd866ff tempest-CreateVolumesFromImageTest-1864577864 None] Lock "cinder-quobyte-ffb4bb14-2ae0-4961-909b-196e638663c3" acquired by "delete_volume" :: waited 0.023s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:02 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[115406d5-5afe-42d2-abb6-2a2ca2abe817]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-be5f4e73-4c5a-46c5-bfca-09782bd866ff tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ffb4bb14-2ae0-4961-909b-196e638663c3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:02 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ffb4bb14-2ae0-4961-909b-196e638663c3 Jul 07 17:39:02 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:02 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6975c469-ab13-4af2-95da-a148d52f06cf tempest-CreateVolumesFromImageTest-1864577864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.836s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:02 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-6975c469-ab13-4af2-95da-a148d52f06cf tempest-CreateVolumesFromImageTest-1864577864 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:39:02 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-6975c469-ab13-4af2-95da-a148d52f06cf tempest-CreateVolumesFromImageTest-1864577864 None] Deleted volume successfully. Jul 07 17:39:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6975c469-ab13-4af2-95da-a148d52f06cf tempest-CreateVolumesFromImageTest-1864577864 None] Lock "cinder-c84c1534-a0e1-464d-8499-409204a4f8e7-delete_volume" released by "delete_volume" :: held 2.937s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:03 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-be5f4e73-4c5a-46c5-bfca-09782bd866ff tempest-CreateVolumesFromImageTest-1864577864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ffb4bb14-2ae0-4961-909b-196e638663c3" returned: 0 in 0.964s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-be5f4e73-4c5a-46c5-bfca-09782bd866ff tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ffb4bb14-2ae0-4961-909b-196e638663c3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:03 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ffb4bb14-2ae0-4961-909b-196e638663c3 Jul 07 17:39:03 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:04 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-be5f4e73-4c5a-46c5-bfca-09782bd866ff tempest-CreateVolumesFromImageTest-1864577864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ffb4bb14-2ae0-4961-909b-196e638663c3" returned: 0 in 0.802s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:04 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-be5f4e73-4c5a-46c5-bfca-09782bd866ff tempest-CreateVolumesFromImageTest-1864577864 None] Lock "cinder-quobyte-ffb4bb14-2ae0-4961-909b-196e638663c3" released by "delete_volume" :: held 1.848s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:04 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-be5f4e73-4c5a-46c5-bfca-09782bd866ff tempest-CreateVolumesFromImageTest-1864577864 None] Created reservations ['7e351155-8a3b-4708-b793-85a37301776b', '959e1ca2-6042-4d0c-9443-4f5866597e29', 'd3ce9f7c-978e-4914-a93c-a03bf3cf5b87', '36d73026-8791-4518-85de-e73dd2ee5384'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:39:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-be5f4e73-4c5a-46c5-bfca-09782bd866ff tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-be5f4e73-4c5a-46c5-bfca-09782bd866ff tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-be5f4e73-4c5a-46c5-bfca-09782bd866ff tempest-CreateVolumesFromImageTest-1864577864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-be5f4e73-4c5a-46c5-bfca-09782bd866ff tempest-CreateVolumesFromImageTest-1864577864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-be5f4e73-4c5a-46c5-bfca-09782bd866ff tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-be5f4e73-4c5a-46c5-bfca-09782bd866ff tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:04 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:39:04 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:04 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a1fad1e3-3969-4516-8da6-e9257a4b99fb tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "cinder-a92a8ac8-a3b8-43e1-8c2d-2bb191a50312-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:04 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a1fad1e3-3969-4516-8da6-e9257a4b99fb tempest-CreateVolumesFromImageTest-1864577864 None] Lock "cinder-a92a8ac8-a3b8-43e1-8c2d-2bb191a50312-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:04 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a1fad1e3-3969-4516-8da6-e9257a4b99fb tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "cinder-quobyte-a92a8ac8-a3b8-43e1-8c2d-2bb191a50312" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:04 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a1fad1e3-3969-4516-8da6-e9257a4b99fb tempest-CreateVolumesFromImageTest-1864577864 None] Lock "cinder-quobyte-a92a8ac8-a3b8-43e1-8c2d-2bb191a50312" acquired by "delete_volume" :: waited 0.018s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:04 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ab7cfb-5746-4ddb-888d-8062a22c0d06]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a1fad1e3-3969-4516-8da6-e9257a4b99fb tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a92a8ac8-a3b8-43e1-8c2d-2bb191a50312 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:04 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a92a8ac8-a3b8-43e1-8c2d-2bb191a50312 Jul 07 17:39:04 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:05 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-be5f4e73-4c5a-46c5-bfca-09782bd866ff tempest-CreateVolumesFromImageTest-1864577864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.768s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:05 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-be5f4e73-4c5a-46c5-bfca-09782bd866ff tempest-CreateVolumesFromImageTest-1864577864 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:39:05 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-be5f4e73-4c5a-46c5-bfca-09782bd866ff tempest-CreateVolumesFromImageTest-1864577864 None] Deleted volume successfully. Jul 07 17:39:05 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-be5f4e73-4c5a-46c5-bfca-09782bd866ff tempest-CreateVolumesFromImageTest-1864577864 None] Lock "cinder-ffb4bb14-2ae0-4961-909b-196e638663c3-delete_volume" released by "delete_volume" :: held 2.889s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:05 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a1fad1e3-3969-4516-8da6-e9257a4b99fb tempest-CreateVolumesFromImageTest-1864577864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a92a8ac8-a3b8-43e1-8c2d-2bb191a50312" returned: 0 in 0.899s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a1fad1e3-3969-4516-8da6-e9257a4b99fb tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a92a8ac8-a3b8-43e1-8c2d-2bb191a50312 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:05 devstack sudo[104140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a92a8ac8-a3b8-43e1-8c2d-2bb191a50312 Jul 07 17:39:05 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:06 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a1fad1e3-3969-4516-8da6-e9257a4b99fb tempest-CreateVolumesFromImageTest-1864577864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a92a8ac8-a3b8-43e1-8c2d-2bb191a50312" returned: 0 in 0.887s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a1fad1e3-3969-4516-8da6-e9257a4b99fb tempest-CreateVolumesFromImageTest-1864577864 None] Lock "cinder-quobyte-a92a8ac8-a3b8-43e1-8c2d-2bb191a50312" released by "delete_volume" :: held 1.837s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:06 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-a1fad1e3-3969-4516-8da6-e9257a4b99fb tempest-CreateVolumesFromImageTest-1864577864 None] Created reservations ['079c0c77-0efa-4697-9d74-f201dfd7eb73', 'b6b2e536-cf5d-4f07-b3a1-bbf2794bca92', '4178f7bf-11c4-46c7-bfaa-cd25b4688ace', 'e62098a0-0ab2-4841-9d4f-1028e67b3021'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:39:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a1fad1e3-3969-4516-8da6-e9257a4b99fb tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a1fad1e3-3969-4516-8da6-e9257a4b99fb tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a1fad1e3-3969-4516-8da6-e9257a4b99fb tempest-CreateVolumesFromImageTest-1864577864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a1fad1e3-3969-4516-8da6-e9257a4b99fb tempest-CreateVolumesFromImageTest-1864577864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a1fad1e3-3969-4516-8da6-e9257a4b99fb tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a1fad1e3-3969-4516-8da6-e9257a4b99fb tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:06 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:39:06 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-de7a5804-f051-4aec-becf-4496e46108c4 tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "cinder-330e8db8-7dda-4afc-9645-429e8c2b8233-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-de7a5804-f051-4aec-becf-4496e46108c4 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "cinder-330e8db8-7dda-4afc-9645-429e8c2b8233-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-de7a5804-f051-4aec-becf-4496e46108c4 tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "cinder-quobyte-330e8db8-7dda-4afc-9645-429e8c2b8233" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-de7a5804-f051-4aec-becf-4496e46108c4 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "cinder-quobyte-330e8db8-7dda-4afc-9645-429e8c2b8233" acquired by "delete_volume" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:06 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9f37df-b16d-4631-8fb5-eacfef2359d3]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-de7a5804-f051-4aec-becf-4496e46108c4 tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-330e8db8-7dda-4afc-9645-429e8c2b8233 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:07 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-330e8db8-7dda-4afc-9645-429e8c2b8233 Jul 07 17:39:07 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:07 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a1fad1e3-3969-4516-8da6-e9257a4b99fb tempest-CreateVolumesFromImageTest-1864577864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.766s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:07 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-a1fad1e3-3969-4516-8da6-e9257a4b99fb tempest-CreateVolumesFromImageTest-1864577864 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:39:07 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-a1fad1e3-3969-4516-8da6-e9257a4b99fb tempest-CreateVolumesFromImageTest-1864577864 None] Deleted volume successfully. Jul 07 17:39:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a1fad1e3-3969-4516-8da6-e9257a4b99fb tempest-CreateVolumesFromImageTest-1864577864 None] Lock "cinder-a92a8ac8-a3b8-43e1-8c2d-2bb191a50312-delete_volume" released by "delete_volume" :: held 2.905s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:07 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-de7a5804-f051-4aec-becf-4496e46108c4 tempest-CreateVolumesFromImageTest-1864577864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-330e8db8-7dda-4afc-9645-429e8c2b8233" returned: 0 in 1.023s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-de7a5804-f051-4aec-becf-4496e46108c4 tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-330e8db8-7dda-4afc-9645-429e8c2b8233 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:08 devstack sudo[104152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-330e8db8-7dda-4afc-9645-429e8c2b8233 Jul 07 17:39:08 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:08 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-de7a5804-f051-4aec-becf-4496e46108c4 tempest-CreateVolumesFromImageTest-1864577864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-330e8db8-7dda-4afc-9645-429e8c2b8233" returned: 0 in 0.755s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-de7a5804-f051-4aec-becf-4496e46108c4 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "cinder-quobyte-330e8db8-7dda-4afc-9645-429e8c2b8233" released by "delete_volume" :: held 1.829s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:08 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-de7a5804-f051-4aec-becf-4496e46108c4 tempest-CreateVolumesFromImageTest-1864577864 None] Created reservations ['c5d56565-09dc-4204-961f-bd24a2fdc091', '63dac72e-3e0c-478b-83c6-f445f2265e99', '967f9cd4-ca58-47cd-add0-f1fba51afa47', 'b3d37e5e-2c0f-48d4-853e-15bd4d66604a'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:39:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-de7a5804-f051-4aec-becf-4496e46108c4 tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-de7a5804-f051-4aec-becf-4496e46108c4 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-de7a5804-f051-4aec-becf-4496e46108c4 tempest-CreateVolumesFromImageTest-1864577864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-de7a5804-f051-4aec-becf-4496e46108c4 tempest-CreateVolumesFromImageTest-1864577864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-de7a5804-f051-4aec-becf-4496e46108c4 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-de7a5804-f051-4aec-becf-4496e46108c4 tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:08 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:39:08 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:09 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-117a6889-9cf8-4462-9f8d-1721c9950d33 tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "cinder-cd34ccd8-1944-4396-ab75-544269b6e07c-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:09 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-117a6889-9cf8-4462-9f8d-1721c9950d33 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "cinder-cd34ccd8-1944-4396-ab75-544269b6e07c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:09 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-117a6889-9cf8-4462-9f8d-1721c9950d33 tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "cinder-quobyte-cd34ccd8-1944-4396-ab75-544269b6e07c" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:09 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-117a6889-9cf8-4462-9f8d-1721c9950d33 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "cinder-quobyte-cd34ccd8-1944-4396-ab75-544269b6e07c" acquired by "delete_volume" :: waited 0.020s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:09 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[607e99b5-427e-4c2d-8788-a3ecc9b5d414]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-117a6889-9cf8-4462-9f8d-1721c9950d33 tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cd34ccd8-1944-4396-ab75-544269b6e07c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:09 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cd34ccd8-1944-4396-ab75-544269b6e07c Jul 07 17:39:09 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:09 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-de7a5804-f051-4aec-becf-4496e46108c4 tempest-CreateVolumesFromImageTest-1864577864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.020s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:09 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-de7a5804-f051-4aec-becf-4496e46108c4 tempest-CreateVolumesFromImageTest-1864577864 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:39:09 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-de7a5804-f051-4aec-becf-4496e46108c4 tempest-CreateVolumesFromImageTest-1864577864 None] Deleted volume successfully. Jul 07 17:39:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-de7a5804-f051-4aec-becf-4496e46108c4 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "cinder-330e8db8-7dda-4afc-9645-429e8c2b8233-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:10 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-117a6889-9cf8-4462-9f8d-1721c9950d33 tempest-CreateVolumesFromImageTest-1864577864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cd34ccd8-1944-4396-ab75-544269b6e07c" returned: 0 in 1.019s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-117a6889-9cf8-4462-9f8d-1721c9950d33 tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cd34ccd8-1944-4396-ab75-544269b6e07c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:10 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cd34ccd8-1944-4396-ab75-544269b6e07c Jul 07 17:39:10 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:11 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-117a6889-9cf8-4462-9f8d-1721c9950d33 tempest-CreateVolumesFromImageTest-1864577864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-cd34ccd8-1944-4396-ab75-544269b6e07c" returned: 0 in 0.761s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-117a6889-9cf8-4462-9f8d-1721c9950d33 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "cinder-quobyte-cd34ccd8-1944-4396-ab75-544269b6e07c" released by "delete_volume" :: held 1.854s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:11 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-117a6889-9cf8-4462-9f8d-1721c9950d33 tempest-CreateVolumesFromImageTest-1864577864 None] Created reservations ['371af5aa-14f9-4e39-93bf-fa70e8a485ef', 'bd3bdd61-1a28-4dd6-8141-ad744a38373f', 'f27713a4-a9df-44cc-95cb-084750151689', '1da10aed-5b83-4a91-b9a8-323e6d37ef48'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:39:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-117a6889-9cf8-4462-9f8d-1721c9950d33 tempest-CreateVolumesFromImageTest-1864577864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-117a6889-9cf8-4462-9f8d-1721c9950d33 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-117a6889-9cf8-4462-9f8d-1721c9950d33 tempest-CreateVolumesFromImageTest-1864577864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-117a6889-9cf8-4462-9f8d-1721c9950d33 tempest-CreateVolumesFromImageTest-1864577864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-117a6889-9cf8-4462-9f8d-1721c9950d33 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-117a6889-9cf8-4462-9f8d-1721c9950d33 tempest-CreateVolumesFromImageTest-1864577864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:11 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:39:11 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:12 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-117a6889-9cf8-4462-9f8d-1721c9950d33 tempest-CreateVolumesFromImageTest-1864577864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.029s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:12 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-117a6889-9cf8-4462-9f8d-1721c9950d33 tempest-CreateVolumesFromImageTest-1864577864 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:39:12 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-117a6889-9cf8-4462-9f8d-1721c9950d33 tempest-CreateVolumesFromImageTest-1864577864 None] Deleted volume successfully. Jul 07 17:39:12 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-117a6889-9cf8-4462-9f8d-1721c9950d33 tempest-CreateVolumesFromImageTest-1864577864 None] Lock "cinder-cd34ccd8-1944-4396-ab75-544269b6e07c-delete_volume" released by "delete_volume" :: held 3.197s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:17 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:39:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Flow 'volume_create_manager' (5f0eabe1-77a0-4189-8978-52020e29e272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b1c32fe-0fda-4101-992f-a61e4443305b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b1c32fe-0fda-4101-992f-a61e4443305b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=128a530b-d99a-43ca-834f-7d9be3919b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0e85262b7574d289618c0f42ea43dfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:18Z,use_quota=True,user_id='cf98ea04af884b23a68ac343ea000e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399514ae-3fbf-4190-925c-b5f5a9b3717e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399514ae-3fbf-4190-925c-b5f5a9b3717e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa33de42-d655-4ef4-babe-d0cb51a09e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:17 devstack cinder-volume[87303]: DEBUG cinder.image.glance [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Creating Keystone auth plugin from conf {{(pid=87303) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:39:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa33de42-d655-4ef4-babe-d0cb51a09e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '128a530b-d99a-43ca-834f-7d9be3919b8c', 'volume_name': 'volume-128a530b-d99a-43ca-834f-7d9be3919b8c', 'volume_size': 1, 'image_id': 'c8684df4-fe53-450e-8be9-027e51ae3bfe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c8684df4-fe53-450e-8be9-027e51ae3bfe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6d2397de1852c1828ceb808c025cd23c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f0e85262b7574d289618c0f42ea43dfb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eb7b518accf4fb54da3e3361ee369109f1dcdaf13ea710540cda3215cedd53b13ad4ad35d004e6bfc27cfa1bdbeeb684d3223f777fc4ee573682a943ff92ca06', 'id': 'c8684df4-fe53-450e-8be9-027e51ae3bfe', 'created_at': datetime.datetime(2026, 7, 7, 15, 39, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 39, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c8684df4-fe53-450e-8be9-027e51ae3bfe/file', 'properties': {}}, 'image_service': }' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42113055-a18b-4f65-8bcd-865aa3d788f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42113055-a18b-4f65-8bcd-865aa3d788f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f9c4ae-13db-49b6-8412-a20c7b52180f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:18 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Volume 128a530b-d99a-43ca-834f-7d9be3919b8c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-128a530b-d99a-43ca-834f-7d9be3919b8c', 'volume_size': 1, 'image_id': 'c8684df4-fe53-450e-8be9-027e51ae3bfe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c8684df4-fe53-450e-8be9-027e51ae3bfe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6d2397de1852c1828ceb808c025cd23c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f0e85262b7574d289618c0f42ea43dfb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eb7b518accf4fb54da3e3361ee369109f1dcdaf13ea710540cda3215cedd53b13ad4ad35d004e6bfc27cfa1bdbeeb684d3223f777fc4ee573682a943ff92ca06', 'id': 'c8684df4-fe53-450e-8be9-027e51ae3bfe', 'created_at': datetime.datetime(2026, 7, 7, 15, 39, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 39, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c8684df4-fe53-450e-8be9-027e51ae3bfe/file', 'properties': {}}, 'image_service': } Jul 07 17:39:18 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Trying to clone 128a530b-d99a-43ca-834f-7d9be3919b8c from image c8684df4-fe53-450e-8be9-027e51ae3bfe at location (None, [{'url': 'file:///opt/stack/data/glance/images/c8684df4-fe53-450e-8be9-027e51ae3bfe', 'metadata': {}}]). {{(pid=87303) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:39:18 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:39:18 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Image download 0.00 MB at 0.00 MB/s Jul 07 17:39:18 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fa56b2-0b0a-419d-91c6-2fd940f87ac6]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:18 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD Jul 07 17:39:18 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:19 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD" returned: 0 in 0.854s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:19 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD Jul 07 17:39:19 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:20 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD" returned: 1 in 0.858s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:39:20 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Temporary image c8684df4-fe53-450e-8be9-027e51ae3bfe is fetched for user cf98ea04af884b23a68ac343ea000e4f. {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:39:20 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5ef596-4594-41ed-8dcd-c5616c57659f]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:20 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD Jul 07 17:39:20 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:21 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD" returned: 0 in 0.893s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:21 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD Jul 07 17:39:21 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:21 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD" returned: 1 in 0.946s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:39:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=128a530b-d99a-43ca-834f-7d9be3919b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0e85262b7574d289618c0f42ea43dfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:18Z,use_quota=True,user_id='cf98ea04af884b23a68ac343ea000e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:39:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Creating volume 128a530b-d99a-43ca-834f-7d9be3919b8c {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:39:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:39:22 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:39:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:22 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c 1073741824 Jul 07 17:39:22 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:23 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c 1073741824" returned: 0 in 1.028s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:23 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c Jul 07 17:39:23 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:23 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c" returned: 0 in 0.709s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:23 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:39:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:23 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Attempting download of c8684df4-fe53-450e-8be9-027e51ae3bfe ((None, [{'url': 'file:///opt/stack/data/glance/images/c8684df4-fe53-450e-8be9-027e51ae3bfe', 'metadata': {}}])) to volume 128a530b-d99a-43ca-834f-7d9be3919b8c. {{(pid=87303) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:39:23 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[093b45ce-9d58-462c-9563-5692dcf84194]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c8684df4-fe53-450e-8be9-027e51ae3bfe_bb1_o6bj {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:23 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c8684df4-fe53-450e-8be9-027e51ae3bfe_bb1_o6bj Jul 07 17:39:23 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:24 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c8684df4-fe53-450e-8be9-027e51ae3bfe_bb1_o6bj" returned: 0 in 0.843s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8684df4-fe53-450e-8be9-027e51ae3bfe_bb1_o6bj {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:24 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8684df4-fe53-450e-8be9-027e51ae3bfe_bb1_o6bj Jul 07 17:39:24 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:25 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8684df4-fe53-450e-8be9-027e51ae3bfe_bb1_o6bj" returned: 1 in 0.886s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8684df4-fe53-450e-8be9-027e51ae3bfe_bb1_o6bj' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:39:25 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[955c7900-3a8e-4d91-a409-5a59c2fa4776]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:25 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD Jul 07 17:39:25 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:26 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD" returned: 0 in 0.976s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:26 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD Jul 07 17:39:26 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:27 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD" returned: 1 in 0.880s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:39:27 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] c8684df4-fe53-450e-8be9-027e51ae3bfe was raw, converting to raw {{(pid=87303) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:39:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:27 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c Jul 07 17:39:27 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:28 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c" returned: 0 in 0.907s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:28 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c8684df4-fe53-450e-8be9-027e51ae3bfe_7me3i9efdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:39:28 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 17:39:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:28 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c 1G Jul 07 17:39:28 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:29 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c 1G" returned: 0 in 0.850s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:29 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffb6b28-adcb-4481-948e-19efd6d8eff1]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:29 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c Jul 07 17:39:29 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:30 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c" returned: 0 in 0.967s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:30 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c Jul 07 17:39:30 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:31 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c" returned: 1 in 0.967s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:39:31 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Downloaded image c8684df4-fe53-450e-8be9-027e51ae3bfe ((None, [{'url': 'file:///opt/stack/data/glance/images/c8684df4-fe53-450e-8be9-027e51ae3bfe', 'metadata': {}}])) to volume 128a530b-d99a-43ca-834f-7d9be3919b8c successfully. {{(pid=87303) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:39:31 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Temporary image c8684df4-fe53-450e-8be9-027e51ae3bfe for user cf98ea04af884b23a68ac343ea000e4f is deleted. {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:39:31 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Marking volume 128a530b-d99a-43ca-834f-7d9be3919b8c as bootable. {{(pid=87303) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:39:31 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Copying metadata from image c8684df4-fe53-450e-8be9-027e51ae3bfe to 128a530b-d99a-43ca-834f-7d9be3919b8c. {{(pid=87303) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:39:31 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Creating volume glance metadata for volume 128a530b-d99a-43ca-834f-7d9be3919b8c backed by image c8684df4-fe53-450e-8be9-027e51ae3bfe with: {'image_id': 'c8684df4-fe53-450e-8be9-027e51ae3bfe', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6d2397de1852c1828ceb808c025cd23c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87303) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:39:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f9c4ae-13db-49b6-8412-a20c7b52180f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-128a530b-d99a-43ca-834f-7d9be3919b8c', 'volume_size': 1, 'image_id': 'c8684df4-fe53-450e-8be9-027e51ae3bfe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c8684df4-fe53-450e-8be9-027e51ae3bfe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6d2397de1852c1828ceb808c025cd23c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f0e85262b7574d289618c0f42ea43dfb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eb7b518accf4fb54da3e3361ee369109f1dcdaf13ea710540cda3215cedd53b13ad4ad35d004e6bfc27cfa1bdbeeb684d3223f777fc4ee573682a943ff92ca06', 'id': 'c8684df4-fe53-450e-8be9-027e51ae3bfe', 'created_at': datetime.datetime(2026, 7, 7, 15, 39, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 39, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c8684df4-fe53-450e-8be9-027e51ae3bfe/file', 'properties': {}}, 'image_service': }' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71572a97-38a4-49fa-8c44-59006a127b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:31 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Volume volume-128a530b-d99a-43ca-834f-7d9be3919b8c (128a530b-d99a-43ca-834f-7d9be3919b8c): created successfully Jul 07 17:39:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71572a97-38a4-49fa-8c44-59006a127b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:31 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Flow 'volume_create_manager' (5f0eabe1-77a0-4189-8978-52020e29e272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:31 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-38e0a636-921f-4f18-9ed4-5773a9144597 tempest-VolumeImageDependencyTests-1626710196 None] Created volume successfully. Jul 07 17:39:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1859a019-3ec9-4a01-90b4-075de8486826 tempest-VolumeImageDependencyTests-1626710196 None] Acquiring lock "cinder-128a530b-d99a-43ca-834f-7d9be3919b8c-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1859a019-3ec9-4a01-90b4-075de8486826 tempest-VolumeImageDependencyTests-1626710196 None] Lock "cinder-128a530b-d99a-43ca-834f-7d9be3919b8c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:32 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1859a019-3ec9-4a01-90b4-075de8486826 tempest-VolumeImageDependencyTests-1626710196 None] Acquiring lock "cinder-quobyte-128a530b-d99a-43ca-834f-7d9be3919b8c" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:32 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1859a019-3ec9-4a01-90b4-075de8486826 tempest-VolumeImageDependencyTests-1626710196 None] Lock "cinder-quobyte-128a530b-d99a-43ca-834f-7d9be3919b8c" acquired by "delete_volume" :: waited 0.018s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:32 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[226179f2-4ada-4fe1-bdf7-9db43a28b3b5]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1859a019-3ec9-4a01-90b4-075de8486826 tempest-VolumeImageDependencyTests-1626710196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:32 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c Jul 07 17:39:32 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:33 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1859a019-3ec9-4a01-90b4-075de8486826 tempest-VolumeImageDependencyTests-1626710196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c" returned: 0 in 0.912s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1859a019-3ec9-4a01-90b4-075de8486826 tempest-VolumeImageDependencyTests-1626710196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:33 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c Jul 07 17:39:33 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:33 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1859a019-3ec9-4a01-90b4-075de8486826 tempest-VolumeImageDependencyTests-1626710196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c" returned: 1 in 0.870s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1859a019-3ec9-4a01-90b4-075de8486826 tempest-VolumeImageDependencyTests-1626710196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:39:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1859a019-3ec9-4a01-90b4-075de8486826 tempest-VolumeImageDependencyTests-1626710196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:33 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c Jul 07 17:39:33 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:34 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1859a019-3ec9-4a01-90b4-075de8486826 tempest-VolumeImageDependencyTests-1626710196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-128a530b-d99a-43ca-834f-7d9be3919b8c" returned: 0 in 0.728s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1859a019-3ec9-4a01-90b4-075de8486826 tempest-VolumeImageDependencyTests-1626710196 None] Lock "cinder-quobyte-128a530b-d99a-43ca-834f-7d9be3919b8c" released by "delete_volume" :: held 2.593s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:34 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-1859a019-3ec9-4a01-90b4-075de8486826 tempest-VolumeImageDependencyTests-1626710196 None] Created reservations ['6b2b9d9a-62bb-4d4e-bb01-0c8264d7744c', 'f3a0234c-e946-494a-b9a9-e48de463e968', 'e0276da9-d0b5-4198-a940-b6c6f4bcd993', '474029c2-99c6-4145-9b12-8b40f5b2423c'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:39:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1859a019-3ec9-4a01-90b4-075de8486826 tempest-VolumeImageDependencyTests-1626710196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1859a019-3ec9-4a01-90b4-075de8486826 tempest-VolumeImageDependencyTests-1626710196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1859a019-3ec9-4a01-90b4-075de8486826 tempest-VolumeImageDependencyTests-1626710196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1859a019-3ec9-4a01-90b4-075de8486826 tempest-VolumeImageDependencyTests-1626710196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1859a019-3ec9-4a01-90b4-075de8486826 tempest-VolumeImageDependencyTests-1626710196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1859a019-3ec9-4a01-90b4-075de8486826 tempest-VolumeImageDependencyTests-1626710196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:34 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:39:34 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:35 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1859a019-3ec9-4a01-90b4-075de8486826 tempest-VolumeImageDependencyTests-1626710196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.779s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:35 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-1859a019-3ec9-4a01-90b4-075de8486826 tempest-VolumeImageDependencyTests-1626710196 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:39:35 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-1859a019-3ec9-4a01-90b4-075de8486826 tempest-VolumeImageDependencyTests-1626710196 None] Deleted volume successfully. Jul 07 17:39:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1859a019-3ec9-4a01-90b4-075de8486826 tempest-VolumeImageDependencyTests-1626710196 None] Lock "cinder-128a530b-d99a-43ca-834f-7d9be3919b8c-delete_volume" released by "delete_volume" :: held 3.617s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:38 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:39:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Flow 'volume_create_manager' (cbc065e1-99e2-4b20-b2b8-f5ce753c85da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5befc078-b0be-4742-bc81-5403749a143c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5befc078-b0be-4742-bc81-5403749a143c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2b60a96-b755-44eb-8cd8-60e1be8dd353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86ec0f9d4314fcc8f4c518939e1dfe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:39Z,use_quota=True,user_id='c5e961ad58a54c0a83844a28ca3f5fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c925d9-baaa-4b2a-8fab-04c19801fe49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c925d9-baaa-4b2a-8fab-04c19801fe49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af1daea-c74b-4ef9-8327-2c6d00b416b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af1daea-c74b-4ef9-8327-2c6d00b416b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2b60a96-b755-44eb-8cd8-60e1be8dd353', 'volume_name': 'volume-e2b60a96-b755-44eb-8cd8-60e1be8dd353', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b5af3a-7314-4a1c-90d4-47a9df591ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b5af3a-7314-4a1c-90d4-47a9df591ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb54707-cb4c-4584-b8b1-e5f3962c0784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:38 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Volume e2b60a96-b755-44eb-8cd8-60e1be8dd353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2b60a96-b755-44eb-8cd8-60e1be8dd353', 'volume_size': 1} Jul 07 17:39:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2b60a96-b755-44eb-8cd8-60e1be8dd353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86ec0f9d4314fcc8f4c518939e1dfe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:39Z,use_quota=True,user_id='c5e961ad58a54c0a83844a28ca3f5fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:39:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Creating volume e2b60a96-b755-44eb-8cd8-60e1be8dd353 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:39:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:39:38 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:39:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e2b60a96-b755-44eb-8cd8-60e1be8dd353 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:39 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e2b60a96-b755-44eb-8cd8-60e1be8dd353 1073741824 Jul 07 17:39:39 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:39 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e2b60a96-b755-44eb-8cd8-60e1be8dd353 1073741824" returned: 0 in 0.924s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e2b60a96-b755-44eb-8cd8-60e1be8dd353 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:39 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e2b60a96-b755-44eb-8cd8-60e1be8dd353 Jul 07 17:39:39 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:40 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e2b60a96-b755-44eb-8cd8-60e1be8dd353" returned: 0 in 0.734s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:40 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:39:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb54707-cb4c-4584-b8b1-e5f3962c0784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2b60a96-b755-44eb-8cd8-60e1be8dd353', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcafa3ae-1b89-4e47-bb6d-400cb95e2449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:40 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Volume volume-e2b60a96-b755-44eb-8cd8-60e1be8dd353 (e2b60a96-b755-44eb-8cd8-60e1be8dd353): created successfully Jul 07 17:39:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcafa3ae-1b89-4e47-bb6d-400cb95e2449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Flow 'volume_create_manager' (cbc065e1-99e2-4b20-b2b8-f5ce753c85da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:40 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-a82c76cb-a547-4478-8b1a-9a86682ba5d0 tempest-CinderUnicodeTest-550678847 None] Created volume successfully. Jul 07 17:39:41 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:39:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Flow 'volume_create_manager' (04cd3af2-08f6-4394-9fb9-b7faea0985dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2639f5-3c3b-4578-b1d1-71d351019ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2639f5-3c3b-4578-b1d1-71d351019ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2060653669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=938a4649-ea8c-4d30-b5bc-b1e968fa3d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86ec0f9d4314fcc8f4c518939e1dfe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:41Z,use_quota=True,user_id='c5e961ad58a54c0a83844a28ca3f5fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443ae7cb-83ce-4405-8857-ca58165fcbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443ae7cb-83ce-4405-8857-ca58165fcbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc03605-8a54-42b3-90d5-abfd851137ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc03605-8a54-42b3-90d5-abfd851137ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '938a4649-ea8c-4d30-b5bc-b1e968fa3d9f', 'volume_name': 'volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ff882f-644c-481f-ab7b-4bd15429dd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ff882f-644c-481f-ab7b-4bd15429dd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436ca504-90a2-4084-9efe-5c0a9ba4a2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:41 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Volume 938a4649-ea8c-4d30-b5bc-b1e968fa3d9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f', 'volume_size': 1} Jul 07 17:39:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:41 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2060653669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=938a4649-ea8c-4d30-b5bc-b1e968fa3d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86ec0f9d4314fcc8f4c518939e1dfe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:41Z,use_quota=True,user_id='c5e961ad58a54c0a83844a28ca3f5fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:39:41 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Creating volume 938a4649-ea8c-4d30-b5bc-b1e968fa3d9f {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:39:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:41 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:41 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:41 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:39:41 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:39:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:41 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f 1073741824 Jul 07 17:39:41 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:42 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f 1073741824" returned: 0 in 0.947s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:42 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f Jul 07 17:39:42 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:43 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f" returned: 0 in 0.728s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:43 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:39:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436ca504-90a2-4084-9efe-5c0a9ba4a2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e893df39-494f-44e5-b0fe-8969f9070316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:43 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Volume volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f (938a4649-ea8c-4d30-b5bc-b1e968fa3d9f): created successfully Jul 07 17:39:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e893df39-494f-44e5-b0fe-8969f9070316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Flow 'volume_create_manager' (04cd3af2-08f6-4394-9fb9-b7faea0985dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:43 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-86848c81-0632-4278-baa9-ad7bac86f15e tempest-CinderUnicodeTest-550678847 None] Created volume successfully. Jul 07 17:39:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d37eb9e9-9d29-4b68-b2c0-85515025c2e2 tempest-CinderUnicodeTest-550678847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d37eb9e9-9d29-4b68-b2c0-85515025c2e2 tempest-CinderUnicodeTest-550678847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:43 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-d37eb9e9-9d29-4b68-b2c0-85515025c2e2 tempest-CinderUnicodeTest-550678847 None] Creating offline snapshot 0cd3522c-fe8b-4887-9fb3-904945da7197 of volume 938a4649-ea8c-4d30-b5bc-b1e968fa3d9f {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:39:43 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba82dc1-3bcb-466f-840c-67f8c99bccc2]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d37eb9e9-9d29-4b68-b2c0-85515025c2e2 tempest-CinderUnicodeTest-550678847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:44 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f Jul 07 17:39:44 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:44 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d37eb9e9-9d29-4b68-b2c0-85515025c2e2 tempest-CinderUnicodeTest-550678847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f" returned: 0 in 0.904s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d37eb9e9-9d29-4b68-b2c0-85515025c2e2 tempest-CinderUnicodeTest-550678847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.0cd3522c-fe8b-4887-9fb3-904945da7197 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:44 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.0cd3522c-fe8b-4887-9fb3-904945da7197 1G Jul 07 17:39:44 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:45 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d37eb9e9-9d29-4b68-b2c0-85515025c2e2 tempest-CinderUnicodeTest-550678847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.0cd3522c-fe8b-4887-9fb3-904945da7197 1G" returned: 0 in 0.892s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d37eb9e9-9d29-4b68-b2c0-85515025c2e2 tempest-CinderUnicodeTest-550678847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.0cd3522c-fe8b-4887-9fb3-904945da7197 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:45 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.0cd3522c-fe8b-4887-9fb3-904945da7197 Jul 07 17:39:45 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:46 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d37eb9e9-9d29-4b68-b2c0-85515025c2e2 tempest-CinderUnicodeTest-550678847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.0cd3522c-fe8b-4887-9fb3-904945da7197" returned: 0 in 0.734s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:46 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-d37eb9e9-9d29-4b68-b2c0-85515025c2e2 tempest-CinderUnicodeTest-550678847 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.0cd3522c-fe8b-4887-9fb3-904945da7197 is being set with open permissions: ugo+rw Jul 07 17:39:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d37eb9e9-9d29-4b68-b2c0-85515025c2e2 tempest-CinderUnicodeTest-550678847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.0cd3522c-fe8b-4887-9fb3-904945da7197 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:46 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.0cd3522c-fe8b-4887-9fb3-904945da7197 Jul 07 17:39:46 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:47 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d37eb9e9-9d29-4b68-b2c0-85515025c2e2 tempest-CinderUnicodeTest-550678847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.0cd3522c-fe8b-4887-9fb3-904945da7197" returned: 0 in 0.762s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:47 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:UPDATE=70,cinder:SELECT=59,cinder:INSERT=19,cinder:DELETE=7 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:39:47 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=48,cinder:UPDATE=78,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:39:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d37eb9e9-9d29-4b68-b2c0-85515025c2e2 tempest-CinderUnicodeTest-550678847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:47 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.info Jul 07 17:39:47 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:48 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d37eb9e9-9d29-4b68-b2c0-85515025c2e2 tempest-CinderUnicodeTest-550678847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.info" returned: 0 in 0.763s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:48 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-d37eb9e9-9d29-4b68-b2c0-85515025c2e2 tempest-CinderUnicodeTest-550678847 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.info is being set with open permissions: ugo+rw Jul 07 17:39:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d37eb9e9-9d29-4b68-b2c0-85515025c2e2 tempest-CinderUnicodeTest-550678847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:48 devstack sudo[104407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.info Jul 07 17:39:48 devstack sudo[104407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:48 devstack sudo[104407]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d37eb9e9-9d29-4b68-b2c0-85515025c2e2 tempest-CinderUnicodeTest-550678847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.info" returned: 0 in 0.704s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d37eb9e9-9d29-4b68-b2c0-85515025c2e2 tempest-CinderUnicodeTest-550678847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.867s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:48 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-d37eb9e9-9d29-4b68-b2c0-85515025c2e2 tempest-CinderUnicodeTest-550678847 None] Create snapshot completed successfully Jul 07 17:39:49 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5dc3aff9-234e-47bb-92f0-4b51687db482 tempest-CinderUnicodeTest-550678847 None] Acquiring lock "cinder-0cd3522c-fe8b-4887-9fb3-904945da7197-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:49 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5dc3aff9-234e-47bb-92f0-4b51687db482 tempest-CinderUnicodeTest-550678847 None] Lock "cinder-0cd3522c-fe8b-4887-9fb3-904945da7197-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:49 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5dc3aff9-234e-47bb-92f0-4b51687db482 tempest-CinderUnicodeTest-550678847 None] Acquiring lock "cinder-quobyte-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:49 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5dc3aff9-234e-47bb-92f0-4b51687db482 tempest-CinderUnicodeTest-550678847 None] Lock "cinder-quobyte-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:49 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5dc3aff9-234e-47bb-92f0-4b51687db482 tempest-CinderUnicodeTest-550678847 None] Acquiring lock "cinder-quobyte-0cd3522c-fe8b-4887-9fb3-904945da7197" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:49 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5dc3aff9-234e-47bb-92f0-4b51687db482 tempest-CinderUnicodeTest-550678847 None] Lock "cinder-quobyte-0cd3522c-fe8b-4887-9fb3-904945da7197" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-5dc3aff9-234e-47bb-92f0-4b51687db482 tempest-CinderUnicodeTest-550678847 None] Deleting offline snapshot 0cd3522c-fe8b-4887-9fb3-904945da7197 of volume 938a4649-ea8c-4d30-b5bc-b1e968fa3d9f {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:39:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-5dc3aff9-234e-47bb-92f0-4b51687db482 tempest-CinderUnicodeTest-550678847 None] snapshot_file for this snap is: volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.0cd3522c-fe8b-4887-9fb3-904945da7197 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:39:49 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8baf551-a248-4db3-8369-ff12f988263e]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5dc3aff9-234e-47bb-92f0-4b51687db482 tempest-CinderUnicodeTest-550678847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.0cd3522c-fe8b-4887-9fb3-904945da7197 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:49 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.0cd3522c-fe8b-4887-9fb3-904945da7197 Jul 07 17:39:49 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:50 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5dc3aff9-234e-47bb-92f0-4b51687db482 tempest-CinderUnicodeTest-550678847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.0cd3522c-fe8b-4887-9fb3-904945da7197" returned: 0 in 0.874s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-5dc3aff9-234e-47bb-92f0-4b51687db482 tempest-CinderUnicodeTest-550678847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:39:50 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cebe79b-ec10-4940-932f-27ec98fec78f]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5dc3aff9-234e-47bb-92f0-4b51687db482 tempest-CinderUnicodeTest-550678847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:50 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f Jul 07 17:39:50 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:51 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5dc3aff9-234e-47bb-92f0-4b51687db482 tempest-CinderUnicodeTest-550678847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f" returned: 0 in 0.892s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5dc3aff9-234e-47bb-92f0-4b51687db482 tempest-CinderUnicodeTest-550678847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.0cd3522c-fe8b-4887-9fb3-904945da7197 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:51 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.0cd3522c-fe8b-4887-9fb3-904945da7197 Jul 07 17:39:51 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:51 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5dc3aff9-234e-47bb-92f0-4b51687db482 tempest-CinderUnicodeTest-550678847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.0cd3522c-fe8b-4887-9fb3-904945da7197" returned: 0 in 0.860s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5dc3aff9-234e-47bb-92f0-4b51687db482 tempest-CinderUnicodeTest-550678847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.0cd3522c-fe8b-4887-9fb3-904945da7197 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:51 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.0cd3522c-fe8b-4887-9fb3-904945da7197 Jul 07 17:39:51 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:52 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5dc3aff9-234e-47bb-92f0-4b51687db482 tempest-CinderUnicodeTest-550678847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f.0cd3522c-fe8b-4887-9fb3-904945da7197" returned: 0 in 0.760s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5dc3aff9-234e-47bb-92f0-4b51687db482 tempest-CinderUnicodeTest-550678847 None] Lock "cinder-quobyte-0cd3522c-fe8b-4887-9fb3-904945da7197" released by "_delete_snapshot" :: held 3.514s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5dc3aff9-234e-47bb-92f0-4b51687db482 tempest-CinderUnicodeTest-550678847 None] Lock "cinder-quobyte-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f" released by "delete_snapshot" :: held 3.548s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-5dc3aff9-234e-47bb-92f0-4b51687db482 tempest-CinderUnicodeTest-550678847 None] Created reservations ['5bd12982-6367-4649-8e2a-5a025209a3e0', '32fd5e7d-c837-418b-924f-a6f4654a23a8', 'e90b39e2-cbad-4f90-aca6-d1a3ebf3a89d', '25d893e9-fb93-4733-9b2a-011070cfd460'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Flow 'volume_create_manager' (827b7605-ad47-49d4-9013-bad43e6ef9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b40b5aa-2ac2-4dad-8c6c-090475f9d201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:52 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5dc3aff9-234e-47bb-92f0-4b51687db482 tempest-CinderUnicodeTest-550678847 None] Delete snapshot completed successfully. Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b40b5aa-2ac2-4dad-8c6c-090475f9d201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1801829427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a988ac-6ca3-43b2-a077-dfb58bebbc95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a6926df46043acb3c30eb8d67fe0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:53Z,use_quota=True,user_id='4491f5e21a5344e191074c56f0522712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec91ca82-6cc8-41f4-9112-797987e95b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec91ca82-6cc8-41f4-9112-797987e95b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f106bbc2-0a98-4aee-9365-a5bcf2f27a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f106bbc2-0a98-4aee-9365-a5bcf2f27a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4a988ac-6ca3-43b2-a077-dfb58bebbc95', 'volume_name': 'volume-d4a988ac-6ca3-43b2-a077-dfb58bebbc95', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f6a4a67-dde9-4891-a0eb-6322b34d0481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f6a4a67-dde9-4891-a0eb-6322b34d0481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68353fd0-b0b2-419f-bb71-e1838fc80170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:52 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Volume d4a988ac-6ca3-43b2-a077-dfb58bebbc95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4a988ac-6ca3-43b2-a077-dfb58bebbc95', 'volume_size': 1} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1801829427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a988ac-6ca3-43b2-a077-dfb58bebbc95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a6926df46043acb3c30eb8d67fe0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:39:53Z,use_quota=True,user_id='4491f5e21a5344e191074c56f0522712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Creating volume d4a988ac-6ca3-43b2-a077-dfb58bebbc95 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:39:52 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d4a988ac-6ca3-43b2-a077-dfb58bebbc95 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:52 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5dc3aff9-234e-47bb-92f0-4b51687db482 tempest-CinderUnicodeTest-550678847 None] Lock "cinder-0cd3522c-fe8b-4887-9fb3-904945da7197-delete_snapshot" released by "delete_snapshot" :: held 3.821s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:53 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d4a988ac-6ca3-43b2-a077-dfb58bebbc95 1073741824 Jul 07 17:39:53 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7ced76f2-4f88-4826-8c78-abee62de7a9e tempest-CinderUnicodeTest-550678847 None] Acquiring lock "cinder-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7ced76f2-4f88-4826-8c78-abee62de7a9e tempest-CinderUnicodeTest-550678847 None] Lock "cinder-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7ced76f2-4f88-4826-8c78-abee62de7a9e tempest-CinderUnicodeTest-550678847 None] Acquiring lock "cinder-quobyte-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7ced76f2-4f88-4826-8c78-abee62de7a9e tempest-CinderUnicodeTest-550678847 None] Lock "cinder-quobyte-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f" acquired by "delete_volume" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:53 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9bd847-c412-4ccd-ba4c-11af8dfb939f]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7ced76f2-4f88-4826-8c78-abee62de7a9e tempest-CinderUnicodeTest-550678847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:53 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f Jul 07 17:39:53 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:53 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d4a988ac-6ca3-43b2-a077-dfb58bebbc95 1073741824" returned: 0 in 0.997s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d4a988ac-6ca3-43b2-a077-dfb58bebbc95 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:54 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d4a988ac-6ca3-43b2-a077-dfb58bebbc95 Jul 07 17:39:54 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:54 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7ced76f2-4f88-4826-8c78-abee62de7a9e tempest-CinderUnicodeTest-550678847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f" returned: 0 in 0.903s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7ced76f2-4f88-4826-8c78-abee62de7a9e tempest-CinderUnicodeTest-550678847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:54 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f Jul 07 17:39:54 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:54 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d4a988ac-6ca3-43b2-a077-dfb58bebbc95" returned: 0 in 0.719s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:54 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:39:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68353fd0-b0b2-419f-bb71-e1838fc80170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4a988ac-6ca3-43b2-a077-dfb58bebbc95', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47d5b91-3a0b-4e75-84f3-a03d791a179e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:39:54 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Volume volume-d4a988ac-6ca3-43b2-a077-dfb58bebbc95 (d4a988ac-6ca3-43b2-a077-dfb58bebbc95): created successfully Jul 07 17:39:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47d5b91-3a0b-4e75-84f3-a03d791a179e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:39:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Flow 'volume_create_manager' (827b7605-ad47-49d4-9013-bad43e6ef9ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:39:54 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b3126773-c9b0-490a-867a-e19f450e08a1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Created volume successfully. Jul 07 17:39:55 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7ced76f2-4f88-4826-8c78-abee62de7a9e tempest-CinderUnicodeTest-550678847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f" returned: 0 in 0.771s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:55 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7ced76f2-4f88-4826-8c78-abee62de7a9e tempest-CinderUnicodeTest-550678847 None] Lock "cinder-quobyte-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f" released by "delete_volume" :: held 1.741s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:55 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-7ced76f2-4f88-4826-8c78-abee62de7a9e tempest-CinderUnicodeTest-550678847 None] Created reservations ['9f16858c-574b-490c-a717-56788822b204', 'd4f8fd8a-1811-406d-b000-415d36ffd4b2', '00a2e4c8-d923-4e7b-a786-07f62ffccfb8', '0e90d83c-008e-4a34-af26-cde28716f1cd'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:39:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7ced76f2-4f88-4826-8c78-abee62de7a9e tempest-CinderUnicodeTest-550678847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7ced76f2-4f88-4826-8c78-abee62de7a9e tempest-CinderUnicodeTest-550678847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:55 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7ced76f2-4f88-4826-8c78-abee62de7a9e tempest-CinderUnicodeTest-550678847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:55 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7ced76f2-4f88-4826-8c78-abee62de7a9e tempest-CinderUnicodeTest-550678847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7ced76f2-4f88-4826-8c78-abee62de7a9e tempest-CinderUnicodeTest-550678847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7ced76f2-4f88-4826-8c78-abee62de7a9e tempest-CinderUnicodeTest-550678847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:55 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:39:55 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:55 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-292363e0-cbc5-4965-b9f7-dc8443d5ade6 tempest-CinderUnicodeTest-550678847 None] Acquiring lock "cinder-e2b60a96-b755-44eb-8cd8-60e1be8dd353-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:55 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-292363e0-cbc5-4965-b9f7-dc8443d5ade6 tempest-CinderUnicodeTest-550678847 None] Lock "cinder-e2b60a96-b755-44eb-8cd8-60e1be8dd353-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:55 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-292363e0-cbc5-4965-b9f7-dc8443d5ade6 tempest-CinderUnicodeTest-550678847 None] Acquiring lock "cinder-quobyte-e2b60a96-b755-44eb-8cd8-60e1be8dd353" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:39:55 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-292363e0-cbc5-4965-b9f7-dc8443d5ade6 tempest-CinderUnicodeTest-550678847 None] Lock "cinder-quobyte-e2b60a96-b755-44eb-8cd8-60e1be8dd353" acquired by "delete_volume" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:39:55 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[922bfe7d-2d9b-4208-b3d7-479d308da7ec]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-292363e0-cbc5-4965-b9f7-dc8443d5ade6 tempest-CinderUnicodeTest-550678847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e2b60a96-b755-44eb-8cd8-60e1be8dd353 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:55 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e2b60a96-b755-44eb-8cd8-60e1be8dd353 Jul 07 17:39:55 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:56 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7ced76f2-4f88-4826-8c78-abee62de7a9e tempest-CinderUnicodeTest-550678847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.759s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:56 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-7ced76f2-4f88-4826-8c78-abee62de7a9e tempest-CinderUnicodeTest-550678847 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:39:56 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-7ced76f2-4f88-4826-8c78-abee62de7a9e tempest-CinderUnicodeTest-550678847 None] Deleted volume successfully. Jul 07 17:39:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7ced76f2-4f88-4826-8c78-abee62de7a9e tempest-CinderUnicodeTest-550678847 None] Lock "cinder-938a4649-ea8c-4d30-b5bc-b1e968fa3d9f-delete_volume" released by "delete_volume" :: held 2.751s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:39:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:56 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-292363e0-cbc5-4965-b9f7-dc8443d5ade6 tempest-CinderUnicodeTest-550678847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e2b60a96-b755-44eb-8cd8-60e1be8dd353" returned: 0 in 0.892s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-292363e0-cbc5-4965-b9f7-dc8443d5ade6 tempest-CinderUnicodeTest-550678847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e2b60a96-b755-44eb-8cd8-60e1be8dd353 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:56 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:39:56 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:56 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e2b60a96-b755-44eb-8cd8-60e1be8dd353 Jul 07 17:39:56 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:57 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.736s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:39:57 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:39:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:39:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:39:57 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-292363e0-cbc5-4965-b9f7-dc8443d5ade6 tempest-CinderUnicodeTest-550678847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e2b60a96-b755-44eb-8cd8-60e1be8dd353" returned: 0 in 0.748s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-292363e0-cbc5-4965-b9f7-dc8443d5ade6 tempest-CinderUnicodeTest-550678847 None] Lock "cinder-quobyte-e2b60a96-b755-44eb-8cd8-60e1be8dd353" released by "delete_volume" :: held 1.688s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:57 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-292363e0-cbc5-4965-b9f7-dc8443d5ade6 tempest-CinderUnicodeTest-550678847 None] Created reservations ['b0ddf068-448f-4335-ba99-da32e747b4f8', '029bcb38-ecc1-406e-8e9a-b520fcaf6d1b', '688a7991-4e9e-4fbb-92e1-d169e8c484eb', 'bbdd23cf-1b52-4f5f-9537-415adc004d35'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:39:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-292363e0-cbc5-4965-b9f7-dc8443d5ade6 tempest-CinderUnicodeTest-550678847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-292363e0-cbc5-4965-b9f7-dc8443d5ade6 tempest-CinderUnicodeTest-550678847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-292363e0-cbc5-4965-b9f7-dc8443d5ade6 tempest-CinderUnicodeTest-550678847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:39:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-292363e0-cbc5-4965-b9f7-dc8443d5ade6 tempest-CinderUnicodeTest-550678847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:39:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-292363e0-cbc5-4965-b9f7-dc8443d5ade6 tempest-CinderUnicodeTest-550678847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-292363e0-cbc5-4965-b9f7-dc8443d5ade6 tempest-CinderUnicodeTest-550678847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:57 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:39:57 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-7a48e1ba-18c4-45f7-b738-706393bc75ef req-d3a89247-75dd-41c1-b39e-765454a2d983 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:39:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-7a48e1ba-18c4-45f7-b738-706393bc75ef req-d3a89247-75dd-41c1-b39e-765454a2d983 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:39:58 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[9002fa91-de42-4928-af17-a4f8345222c2]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:39:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-7a48e1ba-18c4-45f7-b738-706393bc75ef req-d3a89247-75dd-41c1-b39e-765454a2d983 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d4a988ac-6ca3-43b2-a077-dfb58bebbc95 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:39:58 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d4a988ac-6ca3-43b2-a077-dfb58bebbc95 Jul 07 17:39:58 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:39:58 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-292363e0-cbc5-4965-b9f7-dc8443d5ade6 tempest-CinderUnicodeTest-550678847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.807s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:58 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-292363e0-cbc5-4965-b9f7-dc8443d5ade6 tempest-CinderUnicodeTest-550678847 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:39:58 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-292363e0-cbc5-4965-b9f7-dc8443d5ade6 tempest-CinderUnicodeTest-550678847 None] Deleted volume successfully. Jul 07 17:39:58 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-292363e0-cbc5-4965-b9f7-dc8443d5ade6 tempest-CinderUnicodeTest-550678847 None] Lock "cinder-e2b60a96-b755-44eb-8cd8-60e1be8dd353-delete_volume" released by "delete_volume" :: held 2.741s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:39:59 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Jul 07 17:39:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [req-7a48e1ba-18c4-45f7-b738-706393bc75ef req-d3a89247-75dd-41c1-b39e-765454a2d983 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d4a988ac-6ca3-43b2-a077-dfb58bebbc95" returned: 0 in 0.994s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:39:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [req-7a48e1ba-18c4-45f7-b738-706393bc75ef req-d3a89247-75dd-41c1-b39e-765454a2d983 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.021s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:39:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-7a48e1ba-18c4-45f7-b738-706393bc75ef req-d3a89247-75dd-41c1-b39e-765454a2d983 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2', 'name': 'volume-d4a988ac-6ca3-43b2-a077-dfb58bebbc95', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7edcffc5-27d7-41da-b85d-9a7f7d130004', 'enforce_multipath': True} {{(pid=87303) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:39:59 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-7a48e1ba-18c4-45f7-b738-706393bc75ef req-d3a89247-75dd-41c1-b39e-765454a2d983 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] attachment_update completed successfully. Jul 07 17:40:06 devstack cinder-volume[87303]: INFO cinder.volume.manager [req-55b6bafc-5c1e-4ffe-a7ea-6f6dc846d63c req-cfaa1b8c-849f-42e7-bfbb-a10cbee9a4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Terminate volume connection completed successfully. Jul 07 17:40:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [req-55b6bafc-5c1e-4ffe-a7ea-6f6dc846d63c req-cfaa1b8c-849f-42e7-bfbb-a10cbee9a4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Deleting attachment 7edcffc5-27d7-41da-b85d-9a7f7d130004. {{(pid=87303) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:40:08 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4e28ba5f-06ad-464b-a1d7-25b9bcd98819 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Acquiring lock "cinder-d4a988ac-6ca3-43b2-a077-dfb58bebbc95-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:40:09 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4e28ba5f-06ad-464b-a1d7-25b9bcd98819 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Lock "cinder-d4a988ac-6ca3-43b2-a077-dfb58bebbc95-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:40:09 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4e28ba5f-06ad-464b-a1d7-25b9bcd98819 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Acquiring lock "cinder-quobyte-d4a988ac-6ca3-43b2-a077-dfb58bebbc95" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:40:09 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4e28ba5f-06ad-464b-a1d7-25b9bcd98819 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Lock "cinder-quobyte-d4a988ac-6ca3-43b2-a077-dfb58bebbc95" acquired by "delete_volume" :: waited 0.016s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:40:09 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fde853f-bb33-4c04-a945-f5e5febfda90]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e28ba5f-06ad-464b-a1d7-25b9bcd98819 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d4a988ac-6ca3-43b2-a077-dfb58bebbc95 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:09 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d4a988ac-6ca3-43b2-a077-dfb58bebbc95 Jul 07 17:40:09 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:09 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e28ba5f-06ad-464b-a1d7-25b9bcd98819 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d4a988ac-6ca3-43b2-a077-dfb58bebbc95" returned: 0 in 0.848s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e28ba5f-06ad-464b-a1d7-25b9bcd98819 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d4a988ac-6ca3-43b2-a077-dfb58bebbc95 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:09 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d4a988ac-6ca3-43b2-a077-dfb58bebbc95 Jul 07 17:40:09 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:10 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e28ba5f-06ad-464b-a1d7-25b9bcd98819 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d4a988ac-6ca3-43b2-a077-dfb58bebbc95" returned: 0 in 0.826s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4e28ba5f-06ad-464b-a1d7-25b9bcd98819 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Lock "cinder-quobyte-d4a988ac-6ca3-43b2-a077-dfb58bebbc95" released by "delete_volume" :: held 1.721s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:40:10 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-4e28ba5f-06ad-464b-a1d7-25b9bcd98819 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Created reservations ['1ed81711-ada8-4176-a3f7-5c05f2b1fc63', 'cc2cc9c3-e72b-4bf0-83b3-0deaa11614a0', '41f14bb9-bb70-47a8-9086-2e568cc5fe08', '7d7cc377-e7bb-455a-9562-9fdf15d84d82'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:40:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4e28ba5f-06ad-464b-a1d7-25b9bcd98819 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4e28ba5f-06ad-464b-a1d7-25b9bcd98819 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4e28ba5f-06ad-464b-a1d7-25b9bcd98819 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4e28ba5f-06ad-464b-a1d7-25b9bcd98819 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4e28ba5f-06ad-464b-a1d7-25b9bcd98819 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e28ba5f-06ad-464b-a1d7-25b9bcd98819 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:10 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:40:10 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:11 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4e28ba5f-06ad-464b-a1d7-25b9bcd98819 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.718s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:11 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-4e28ba5f-06ad-464b-a1d7-25b9bcd98819 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:40:11 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-4e28ba5f-06ad-464b-a1d7-25b9bcd98819 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Deleted volume successfully. Jul 07 17:40:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4e28ba5f-06ad-464b-a1d7-25b9bcd98819 tempest-TestServerVolumeAttachScenarioOldVersion-1032468756 None] Lock "cinder-d4a988ac-6ca3-43b2-a077-dfb58bebbc95-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:40:20 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=30,cinder:UPDATE=38,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:40:21 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:DELETE=4,cinder:SELECT=32,cinder:INSERT=9,cinder:UPDATE=33 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:40:33 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:40:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Flow 'volume_create_manager' (515735ff-46c3-42ad-948d-d1b317c37808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3193e7cc-505f-47ac-90dd-702e05d2b3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3193e7cc-505f-47ac-90dd-702e05d2b3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be8ccdb083544eebaa8d63646337567d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:34Z,use_quota=True,user_id='b97f04cd5306461f86df296cc28fcc1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6aef65d6-3f04-4332-801f-861f204e023e),volume_type_id=6aef65d6-3f04-4332-801f-861f204e023e)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d63e233-36c4-4935-a43f-11f88e9228a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d63e233-36c4-4935-a43f-11f88e9228a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d1768a-b670-4af4-a29c-97037a4f2c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:33 devstack cinder-volume[87303]: DEBUG cinder.image.glance [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Creating Keystone auth plugin from conf {{(pid=87303) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:40:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d1768a-b670-4af4-a29c-97037a4f2c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3', 'volume_name': 'volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3', 'volume_size': 1, 'image_id': 'b35eb15e-a91a-4beb-928a-b568bad9fc08', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b35eb15e-a91a-4beb-928a-b568bad9fc08', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '26fca633604711a974d23b5bbb4c9404', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be8ccdb083544eebaa8d63646337567d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1d08db315af1949c449fdaeb20fc9c756c07bc2bef1f1630bf45088305540973e31d6e65e1419af1238f7b4be3f7c56fe47dd7e8968403658cd27624c934c4e1', 'id': 'b35eb15e-a91a-4beb-928a-b568bad9fc08', 'created_at': datetime.datetime(2026, 7, 7, 15, 40, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 40, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b35eb15e-a91a-4beb-928a-b568bad9fc08/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a673fa-fa2d-4319-8b27-4782e43b649a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a673fa-fa2d-4319-8b27-4782e43b649a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6906f7ed-4e8c-4e34-9268-d8efaf60b3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:34 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Volume acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3', 'volume_size': 1, 'image_id': 'b35eb15e-a91a-4beb-928a-b568bad9fc08', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b35eb15e-a91a-4beb-928a-b568bad9fc08', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '26fca633604711a974d23b5bbb4c9404', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be8ccdb083544eebaa8d63646337567d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1d08db315af1949c449fdaeb20fc9c756c07bc2bef1f1630bf45088305540973e31d6e65e1419af1238f7b4be3f7c56fe47dd7e8968403658cd27624c934c4e1', 'id': 'b35eb15e-a91a-4beb-928a-b568bad9fc08', 'created_at': datetime.datetime(2026, 7, 7, 15, 40, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 40, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b35eb15e-a91a-4beb-928a-b568bad9fc08/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 17:40:34 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Trying to clone acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 from image b35eb15e-a91a-4beb-928a-b568bad9fc08 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b35eb15e-a91a-4beb-928a-b568bad9fc08', 'metadata': {}}]). {{(pid=87303) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:40:34 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:40:34 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Image download 0.00 MB at 0.00 MB/s Jul 07 17:40:34 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d15179-616f-442e-8f80-7d05b8860349]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:34 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD Jul 07 17:40:34 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:35 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD" returned: 0 in 0.804s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:35 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD Jul 07 17:40:35 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:35 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD" returned: 1 in 0.819s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:40:35 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Temporary image b35eb15e-a91a-4beb-928a-b568bad9fc08 is fetched for user b97f04cd5306461f86df296cc28fcc1c. {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:40:36 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[7656d237-38e7-4d0a-a661-e7c0f0b40846]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:36 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD Jul 07 17:40:36 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:36 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD" returned: 0 in 0.772s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:36 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD Jul 07 17:40:36 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:37 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD" returned: 1 in 0.803s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:40:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be8ccdb083544eebaa8d63646337567d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:40:34Z,use_quota=True,user_id='b97f04cd5306461f86df296cc28fcc1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6aef65d6-3f04-4332-801f-861f204e023e),volume_type_id=6aef65d6-3f04-4332-801f-861f204e023e)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:40:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Creating volume acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:40:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:40:37 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:40:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:37 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 1073741824 Jul 07 17:40:37 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:38 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 1073741824" returned: 0 in 0.882s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:38 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 Jul 07 17:40:38 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:39 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3" returned: 0 in 0.744s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:39 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:40:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:39 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Attempting download of b35eb15e-a91a-4beb-928a-b568bad9fc08 ((None, [{'url': 'file:///opt/stack/data/glance/images/b35eb15e-a91a-4beb-928a-b568bad9fc08', 'metadata': {}}])) to volume acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3. {{(pid=87303) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:40:39 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcc47de-01c6-49ec-a654-ad6b272646b3]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b35eb15e-a91a-4beb-928a-b568bad9fc08_k9jm3ak5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:39 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b35eb15e-a91a-4beb-928a-b568bad9fc08_k9jm3ak5 Jul 07 17:40:39 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:40 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b35eb15e-a91a-4beb-928a-b568bad9fc08_k9jm3ak5" returned: 0 in 0.743s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b35eb15e-a91a-4beb-928a-b568bad9fc08_k9jm3ak5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:40 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b35eb15e-a91a-4beb-928a-b568bad9fc08_k9jm3ak5 Jul 07 17:40:40 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:40 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b35eb15e-a91a-4beb-928a-b568bad9fc08_k9jm3ak5" returned: 1 in 0.768s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b35eb15e-a91a-4beb-928a-b568bad9fc08_k9jm3ak5' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:40:40 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[9805725c-1b71-4675-82a4-7af620052f54]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:40 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD Jul 07 17:40:40 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:41 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD" returned: 0 in 0.831s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:41 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD Jul 07 17:40:41 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:42 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD" returned: 1 in 0.813s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:40:42 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] b35eb15e-a91a-4beb-928a-b568bad9fc08 was raw, converting to raw {{(pid=87303) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:40:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:42 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 Jul 07 17:40:42 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:43 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3" returned: 0 in 0.816s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:43 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b35eb15e-a91a-4beb-928a-b568bad9fc08_a1sw2o0bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:40:43 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 17:40:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:43 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 1G Jul 07 17:40:43 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:44 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 1G" returned: 0 in 0.785s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:44 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3b8e01-1669-4789-adb0-fd9ba78cedce]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:44 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 Jul 07 17:40:44 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:44 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3" returned: 0 in 0.814s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:45 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 Jul 07 17:40:45 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:45 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3" returned: 1 in 0.804s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:40:45 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Downloaded image b35eb15e-a91a-4beb-928a-b568bad9fc08 ((None, [{'url': 'file:///opt/stack/data/glance/images/b35eb15e-a91a-4beb-928a-b568bad9fc08', 'metadata': {}}])) to volume acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 successfully. {{(pid=87303) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:40:45 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Temporary image b35eb15e-a91a-4beb-928a-b568bad9fc08 for user b97f04cd5306461f86df296cc28fcc1c is deleted. {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:40:45 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Marking volume acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 as bootable. {{(pid=87303) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:40:45 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Copying metadata from image b35eb15e-a91a-4beb-928a-b568bad9fc08 to acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3. {{(pid=87303) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:40:45 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Creating volume glance metadata for volume acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 backed by image b35eb15e-a91a-4beb-928a-b568bad9fc08 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b35eb15e-a91a-4beb-928a-b568bad9fc08', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '26fca633604711a974d23b5bbb4c9404', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87303) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:40:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6906f7ed-4e8c-4e34-9268-d8efaf60b3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3', 'volume_size': 1, 'image_id': 'b35eb15e-a91a-4beb-928a-b568bad9fc08', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b35eb15e-a91a-4beb-928a-b568bad9fc08', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '26fca633604711a974d23b5bbb4c9404', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be8ccdb083544eebaa8d63646337567d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1d08db315af1949c449fdaeb20fc9c756c07bc2bef1f1630bf45088305540973e31d6e65e1419af1238f7b4be3f7c56fe47dd7e8968403658cd27624c934c4e1', 'id': 'b35eb15e-a91a-4beb-928a-b568bad9fc08', 'created_at': datetime.datetime(2026, 7, 7, 15, 40, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 40, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b35eb15e-a91a-4beb-928a-b568bad9fc08/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6028a708-e7b9-4835-9bb4-87f127e34026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:40:45 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Volume volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 (acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3): created successfully Jul 07 17:40:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6028a708-e7b9-4835-9bb4-87f127e34026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:40:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Flow 'volume_create_manager' (515735ff-46c3-42ad-948d-d1b317c37808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:40:45 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-62d1436f-fc1a-4f4c-b3f8-96db1eb8815d tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Created volume successfully. Jul 07 17:40:46 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Acquiring lock "cinder-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:40:46 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Lock "cinder-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:40:46 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Acquiring lock "cinder-quobyte-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:40:46 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Lock "cinder-quobyte-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3" acquired by "delete_volume" :: waited 0.020s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:40:46 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f0e6e7-1dd1-4262-bab8-5a82b828932a]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:40:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:46 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 Jul 07 17:40:46 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:47 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3" returned: 0 in 0.824s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:47 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 Jul 07 17:40:47 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:48 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3" returned: 1 in 0.789s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:40:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:48 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3 Jul 07 17:40:48 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:49 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3" returned: 0 in 0.682s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:49 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Lock "cinder-quobyte-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3" released by "delete_volume" :: held 2.368s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:40:49 devstack cinder-volume[87303]: WARNING cinder.quota [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:40:49 devstack cinder-volume[87303]: WARNING cinder.quota [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:40:49 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Created reservations ['d70e9147-1546-43bd-93d5-64f8cb41c2d6', '7062b379-280b-4fce-baca-07619ef588e3', '745e5391-145d-4cd7-8c50-368ad8cbc535', '9791d431-202c-4fcd-aa5a-1b2600a7a3c0'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:40:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:49 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:40:49 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:49 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.705s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:49 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:40:49 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Deleted volume successfully. Jul 07 17:40:49 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-27c5ac20-eb75-4be4-aef4-2563418554bc tempest-VolumeAndVolumeTypeFromImageTest-1413036161 None] Lock "cinder-acaff41b-5e0f-4340-8e27-8d8e2f3bc6f3-delete_volume" released by "delete_volume" :: held 3.295s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:40:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:40:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:40:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:40:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:40:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:40:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:40:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:40:56 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:40:56 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:40:57 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Jul 07 17:40:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.695s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:40:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:40:57 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:40:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:40:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:40:59 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=12,cinder:INSERT=7,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:40:59 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:UPDATE=11,cinder:SELECT=14,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Flow 'volume_create_manager' (7d1701e3-9da2-4c7f-8093-f98ce1cfa021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608df35f-b94e-4d69-86b3-ba32750918ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608df35f-b94e-4d69-86b3-ba32750918ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-824111010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84642159-1f24-472c-8464-50bd509bc4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f90b720b394234bf3dd532abef92e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:05Z,use_quota=True,user_id='bc83121ff3b3407c97024246f349b048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (362b0b53-2bcd-4d1b-b4d6-1105352adc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (362b0b53-2bcd-4d1b-b4d6-1105352adc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dcab1be-7e14-4632-a922-f04417c84243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dcab1be-7e14-4632-a922-f04417c84243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84642159-1f24-472c-8464-50bd509bc4d3', 'volume_name': 'volume-84642159-1f24-472c-8464-50bd509bc4d3', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56beb0eb-26c0-4bfc-942c-428922218b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56beb0eb-26c0-4bfc-942c-428922218b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e63f474-8f4c-4729-95e1-ac9d32bc0ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:04 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Volume 84642159-1f24-472c-8464-50bd509bc4d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84642159-1f24-472c-8464-50bd509bc4d3', 'volume_size': 1} Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-824111010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84642159-1f24-472c-8464-50bd509bc4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f90b720b394234bf3dd532abef92e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:05Z,use_quota=True,user_id='bc83121ff3b3407c97024246f349b048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Creating volume 84642159-1f24-472c-8464-50bd509bc4d3 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:04 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:04 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3 1073741824 Jul 07 17:41:04 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Flow 'volume_create_manager' (535cfdca-bd5c-434a-adf9-50949aed46ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe903a4-6bd3-4c6e-8092-42659d7bc001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe903a4-6bd3-4c6e-8092-42659d7bc001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-335785540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d91d5bf-887f-4ba0-a855-7b4a7465eaef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485e8d8fdb3440658f588383c267e9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:05Z,use_quota=True,user_id='0ce9ef6c4083475dba366864ade732ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a38acfb-3935-49a5-a8ec-91fa5bc2ec03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a38acfb-3935-49a5-a8ec-91fa5bc2ec03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d5b89f-d62e-4812-9c76-f9932cd8b1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d5b89f-d62e-4812-9c76-f9932cd8b1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d91d5bf-887f-4ba0-a855-7b4a7465eaef', 'volume_name': 'volume-3d91d5bf-887f-4ba0-a855-7b4a7465eaef', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0666f583-cb50-48e1-bdfc-2c796a25ed55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0666f583-cb50-48e1-bdfc-2c796a25ed55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c43c74a7-21fd-4c32-b362-744f30927845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Volume 3d91d5bf-887f-4ba0-a855-7b4a7465eaef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d91d5bf-887f-4ba0-a855-7b4a7465eaef', 'volume_size': 1} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Flow 'volume_create_manager' (85e19510-3fe6-4c31-8640-bb751c871d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2435f7-5c0e-45f9-9d7b-8e56aa66ef2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2435f7-5c0e-45f9-9d7b-8e56aa66ef2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2107771137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485e8d8fdb3440658f588383c267e9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:05Z,use_quota=True,user_id='0ce9ef6c4083475dba366864ade732ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ad894a-307f-41e8-83fb-cf636c0232a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ad894a-307f-41e8-83fb-cf636c0232a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8853184a-e4c3-4226-89d3-3ed7d597fcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8853184a-e4c3-4226-89d3-3ed7d597fcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0', 'volume_name': 'volume-d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d457fe0b-55bf-4791-a465-f4cece98b168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d457fe0b-55bf-4791-a465-f4cece98b168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195ca244-fab7-4d3d-a8e8-112a0923a0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Volume d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0', 'volume_size': 1} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Flow 'volume_create_manager' (c0301361-131c-4f33-ab0f-fac0b274271f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06311e5-fcd6-4d1d-9ce4-c3f60dc015e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06311e5-fcd6-4d1d-9ce4-c3f60dc015e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-389267775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e94ecac6-cb63-4a3e-aa8a-39057caabafe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bedced91c0c4676b85958d3f30d1d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:06Z,use_quota=True,user_id='a21d7d08a53449dd94e8c4bfbbf5551c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b312e6-0dc6-4209-94d1-9ff148c6ea53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b312e6-0dc6-4209-94d1-9ff148c6ea53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319e908b-a5c3-4353-b9f1-2cf9c3bec02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319e908b-a5c3-4353-b9f1-2cf9c3bec02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e94ecac6-cb63-4a3e-aa8a-39057caabafe', 'volume_name': 'volume-e94ecac6-cb63-4a3e-aa8a-39057caabafe', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777f8457-1997-44ba-9cde-6112c407ce50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777f8457-1997-44ba-9cde-6112c407ce50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b48a20aa-989a-4e6d-8782-dcbf0d85fc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:05 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Volume e94ecac6-cb63-4a3e-aa8a-39057caabafe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e94ecac6-cb63-4a3e-aa8a-39057caabafe', 'volume_size': 1} Jul 07 17:41:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Flow 'volume_create_manager' (78bfb68b-fc39-492d-a267-40cca46c1b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f4107e-4265-4f2a-9e97-faa3988e7b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f4107e-4265-4f2a-9e97-faa3988e7b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1998041065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bbd9150-4c8c-4d34-98d0-672b16eb1275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485e8d8fdb3440658f588383c267e9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:06Z,use_quota=True,user_id='0ce9ef6c4083475dba366864ade732ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3c18e7-cb49-499e-b4cf-2861b32e57b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3c18e7-cb49-499e-b4cf-2861b32e57b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8877f3-0780-4d1d-8827-0c2315459ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8877f3-0780-4d1d-8827-0c2315459ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bbd9150-4c8c-4d34-98d0-672b16eb1275', 'volume_name': 'volume-8bbd9150-4c8c-4d34-98d0-672b16eb1275', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b248105-5ad5-4806-8986-ebb34819c21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b248105-5ad5-4806-8986-ebb34819c21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fffa5a20-d9b7-4a89-9853-85dd9fa4d847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:06 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Volume 8bbd9150-4c8c-4d34-98d0-672b16eb1275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bbd9150-4c8c-4d34-98d0-672b16eb1275', 'volume_size': 1} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:06 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3 1073741824" returned: 0 in 1.349s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:06 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3 Jul 07 17:41:06 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Flow 'volume_create_manager' (168a4908-17b1-4493-bef4-354195250dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62829d8-be91-4ba9-88e6-0e66bd3be838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62829d8-be91-4ba9-88e6-0e66bd3be838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-285842840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6fb0f97-be9d-41db-9110-603249899c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485e8d8fdb3440658f588383c267e9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:06Z,use_quota=True,user_id='0ce9ef6c4083475dba366864ade732ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ef752d-b5b2-422b-8789-80c0c42e34ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ef752d-b5b2-422b-8789-80c0c42e34ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842ebbc5-51a6-4243-8e1f-ce3ab031dca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842ebbc5-51a6-4243-8e1f-ce3ab031dca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6fb0f97-be9d-41db-9110-603249899c1f', 'volume_name': 'volume-e6fb0f97-be9d-41db-9110-603249899c1f', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57e299d-2c6f-4c5e-a1f5-2ef78bf105e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57e299d-2c6f-4c5e-a1f5-2ef78bf105e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067fb672-d8e2-4aeb-9262-18cce8e62a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:06 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Volume e6fb0f97-be9d-41db-9110-603249899c1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6fb0f97-be9d-41db-9110-603249899c1f', 'volume_size': 1} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Flow 'volume_create_manager' (967b653f-88ec-4329-b6d5-4cdfb59cee9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c1ba3cd-6914-4d37-b8c0-52346a573719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c1ba3cd-6914-4d37-b8c0-52346a573719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2039458962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7192f8-cdf4-40bb-a187-31d8ad12d7d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485e8d8fdb3440658f588383c267e9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:07Z,use_quota=True,user_id='0ce9ef6c4083475dba366864ade732ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998894b4-9a52-4afe-a21f-6a32897bd19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998894b4-9a52-4afe-a21f-6a32897bd19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f44e700-8838-4618-b460-e93880e3b4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f44e700-8838-4618-b460-e93880e3b4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf7192f8-cdf4-40bb-a187-31d8ad12d7d4', 'volume_name': 'volume-bf7192f8-cdf4-40bb-a187-31d8ad12d7d4', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35872041-bda0-4a4d-b783-4b6b1c740356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35872041-bda0-4a4d-b783-4b6b1c740356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72109b86-7609-4845-a266-281db05be0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:07 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Volume bf7192f8-cdf4-40bb-a187-31d8ad12d7d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf7192f8-cdf4-40bb-a187-31d8ad12d7d4', 'volume_size': 1} Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:07 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3" returned: 0 in 0.887s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] <== create_volume: return (2299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.302s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.101s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-335785540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d91d5bf-887f-4ba0-a855-7b4a7465eaef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485e8d8fdb3440658f588383c267e9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:05Z,use_quota=True,user_id='0ce9ef6c4083475dba366864ade732ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Creating volume 3d91d5bf-887f-4ba0-a855-7b4a7465eaef {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:07 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d91d5bf-887f-4ba0-a855-7b4a7465eaef 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e63f474-8f4c-4729-95e1-ac9d32bc0ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84642159-1f24-472c-8464-50bd509bc4d3', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:07 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d91d5bf-887f-4ba0-a855-7b4a7465eaef 1073741824 Jul 07 17:41:07 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b26fd7c-9073-4ce5-ba61-f1f2d9a26c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:07 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Volume volume-84642159-1f24-472c-8464-50bd509bc4d3 (84642159-1f24-472c-8464-50bd509bc4d3): created successfully Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b26fd7c-9073-4ce5-ba61-f1f2d9a26c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Flow 'volume_create_manager' (7d1701e3-9da2-4c7f-8093-f98ce1cfa021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:07 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-d177c23d-d546-4bda-80b9-1b03a77b7962 tempest-CreateVolumesFromSnapshotTest-116157209 None] Created volume successfully. Jul 07 17:41:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e4f4ad3c-7ebf-4711-9db3-387b8c88fcc1 tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:08 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d91d5bf-887f-4ba0-a855-7b4a7465eaef 1073741824" returned: 0 in 1.081s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d91d5bf-887f-4ba0-a855-7b4a7465eaef {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:08 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d91d5bf-887f-4ba0-a855-7b4a7465eaef Jul 07 17:41:08 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:09 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d91d5bf-887f-4ba0-a855-7b4a7465eaef" returned: 0 in 0.784s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.841s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2107771137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485e8d8fdb3440658f588383c267e9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:05Z,use_quota=True,user_id='0ce9ef6c4083475dba366864ade732ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Creating volume d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:09 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:09 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0 1073741824 Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c43c74a7-21fd-4c32-b362-744f30927845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d91d5bf-887f-4ba0-a855-7b4a7465eaef', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:09 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0a0ea0-2ffb-410a-aa8c-7190822f2651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:09 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Volume volume-3d91d5bf-887f-4ba0-a855-7b4a7465eaef (3d91d5bf-887f-4ba0-a855-7b4a7465eaef): created successfully Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0a0ea0-2ffb-410a-aa8c-7190822f2651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Flow 'volume_create_manager' (535cfdca-bd5c-434a-adf9-50949aed46ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:09 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b20665d1-bc15-4d99-b3a7-974cdeae191f tempest-CreateVolumesFromImageTest-1080326515 None] Created volume successfully. Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Flow 'volume_create_manager' (52e57500-3a94-4fd4-85a0-f0ef7ffca4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0080c8c-2036-49af-8e50-5cd4dcc4eec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0080c8c-2036-49af-8e50-5cd4dcc4eec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3827babc-d397-42d4-9aa0-20df38790a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d80fa0f78ef4ede945be5ae93eded2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:09Z,use_quota=True,user_id='b4187a31fa534cd19d1a77440fc452e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f338934-b74a-4e97-b7bd-ff2ea26024bb),volume_type_id=5f338934-b74a-4e97-b7bd-ff2ea26024bb)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bea7c50-45de-443c-ada3-b454c92ee1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bea7c50-45de-443c-ada3-b454c92ee1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4b630d-702c-4f4b-9b82-974ce9e99db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.image.glance [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Creating Keystone auth plugin from conf {{(pid=87303) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4b630d-702c-4f4b-9b82-974ce9e99db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3827babc-d397-42d4-9aa0-20df38790a05', 'volume_name': 'volume-3827babc-d397-42d4-9aa0-20df38790a05', 'volume_size': 1, 'image_id': '6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '48da8f64d4ec83a27371874e103455d8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d80fa0f78ef4ede945be5ae93eded2a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2cc4ffca61c43729ce1f53757e3b111f0e2c7819c0e30746f874a2d1c6649ec7baf12ca6272053534c87c2b3609a159ff7cfb41c82f963cb7c424ce6cde13dd9', 'id': '6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b', 'created_at': datetime.datetime(2026, 7, 7, 15, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9a92b0-6e1d-45a1-9def-d83e49309aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9a92b0-6e1d-45a1-9def-d83e49309aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc07eae-e286-4ce2-af74-ee25d5187f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:09 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Volume 3827babc-d397-42d4-9aa0-20df38790a05: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3827babc-d397-42d4-9aa0-20df38790a05', 'volume_size': 1, 'image_id': '6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '48da8f64d4ec83a27371874e103455d8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d80fa0f78ef4ede945be5ae93eded2a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2cc4ffca61c43729ce1f53757e3b111f0e2c7819c0e30746f874a2d1c6649ec7baf12ca6272053534c87c2b3609a159ff7cfb41c82f963cb7c424ce6cde13dd9', 'id': '6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b', 'created_at': datetime.datetime(2026, 7, 7, 15, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Trying to clone 3827babc-d397-42d4-9aa0-20df38790a05 from image 6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b at location (None, [{'url': 'file:///opt/stack/data/glance/images/6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b', 'metadata': {}}]). {{(pid=87303) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:41:09 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Image download 0.00 MB at 0.00 MB/s Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a63db0-b3c4-4114-999d-c45bdddff21f]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:09 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD Jul 07 17:41:09 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:10 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0 1073741824" returned: 0 in 0.994s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:10 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0 Jul 07 17:41:10 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:10 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD" returned: 0 in 0.877s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:10 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD Jul 07 17:41:10 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:10 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0" returned: 0 in 0.732s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.985s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-389267775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e94ecac6-cb63-4a3e-aa8a-39057caabafe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bedced91c0c4676b85958d3f30d1d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:06Z,use_quota=True,user_id='a21d7d08a53449dd94e8c4bfbbf5551c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Creating volume e94ecac6-cb63-4a3e-aa8a-39057caabafe {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:10 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:41:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e94ecac6-cb63-4a3e-aa8a-39057caabafe 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:10 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e94ecac6-cb63-4a3e-aa8a-39057caabafe 1073741824 Jul 07 17:41:10 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195ca244-fab7-4d3d-a8e8-112a0923a0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b2dd37-73f5-46f7-a0fc-da1c8ea24659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:10 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Volume volume-d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0 (d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0): created successfully Jul 07 17:41:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b2dd37-73f5-46f7-a0fc-da1c8ea24659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:10 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Flow 'volume_create_manager' (85e19510-3fe6-4c31-8640-bb751c871d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:11 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-e2c976d0-7585-48bc-a602-5543b7d05508 tempest-CreateVolumesFromImageTest-1080326515 None] Created volume successfully. Jul 07 17:41:11 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD" returned: 1 in 0.817s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:41:11 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Temporary image 6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b is fetched for user b4187a31fa534cd19d1a77440fc452e7. {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:41:11 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[c149a0fc-0866-4c2d-8fd5-3a30dd17a880]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:11 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD Jul 07 17:41:11 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:11 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e94ecac6-cb63-4a3e-aa8a-39057caabafe 1073741824" returned: 0 in 0.934s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e94ecac6-cb63-4a3e-aa8a-39057caabafe {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:11 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e94ecac6-cb63-4a3e-aa8a-39057caabafe Jul 07 17:41:11 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:12 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD" returned: 0 in 0.847s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:12 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD Jul 07 17:41:12 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:12 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e94ecac6-cb63-4a3e-aa8a-39057caabafe" returned: 0 in 0.768s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.471s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1998041065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bbd9150-4c8c-4d34-98d0-672b16eb1275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485e8d8fdb3440658f588383c267e9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:06Z,use_quota=True,user_id='0ce9ef6c4083475dba366864ade732ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Creating volume 8bbd9150-4c8c-4d34-98d0-672b16eb1275 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:12 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:41:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8bbd9150-4c8c-4d34-98d0-672b16eb1275 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b48a20aa-989a-4e6d-8782-dcbf0d85fc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e94ecac6-cb63-4a3e-aa8a-39057caabafe', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:12 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8bbd9150-4c8c-4d34-98d0-672b16eb1275 1073741824 Jul 07 17:41:12 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3fab470-6a57-4f3c-8c51-de1c5520859d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:12 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Volume volume-e94ecac6-cb63-4a3e-aa8a-39057caabafe (e94ecac6-cb63-4a3e-aa8a-39057caabafe): created successfully Jul 07 17:41:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3fab470-6a57-4f3c-8c51-de1c5520859d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Flow 'volume_create_manager' (c0301361-131c-4f33-ab0f-fac0b274271f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:12 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-6a306591-ea2d-4773-827d-ac84a78880f5 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Created volume successfully. Jul 07 17:41:13 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD" returned: 1 in 0.841s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:41:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:13 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Flow 'volume_create_manager' (16f9126d-68b5-425a-b9d9-868f48236979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37af7d5c-3d23-4e96-ae6d-803bb505d29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37af7d5c-3d23-4e96-ae6d-803bb505d29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-847931118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e87768-66e2-4e1d-b53a-505ec5d3d081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bedced91c0c4676b85958d3f30d1d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:14Z,use_quota=True,user_id='a21d7d08a53449dd94e8c4bfbbf5551c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4f3866-e4ee-4c04-979f-8587f89c328d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4f3866-e4ee-4c04-979f-8587f89c328d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488a1bd0-da3a-4ddc-bdc4-a7ba900cae4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488a1bd0-da3a-4ddc-bdc4-a7ba900cae4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4e87768-66e2-4e1d-b53a-505ec5d3d081', 'volume_name': 'volume-e4e87768-66e2-4e1d-b53a-505ec5d3d081', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ceac32-e46f-4f9e-9d93-91e1d141bc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ceac32-e46f-4f9e-9d93-91e1d141bc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c58af4-6640-412d-8aef-99d1934195fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:13 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Volume e4e87768-66e2-4e1d-b53a-505ec5d3d081: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4e87768-66e2-4e1d-b53a-505ec5d3d081', 'volume_size': 1} Jul 07 17:41:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:13 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8bbd9150-4c8c-4d34-98d0-672b16eb1275 1073741824" returned: 0 in 1.215s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8bbd9150-4c8c-4d34-98d0-672b16eb1275 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:14 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8bbd9150-4c8c-4d34-98d0-672b16eb1275 Jul 07 17:41:14 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Flow 'volume_create_manager' (4d985971-ae38-4f1f-9492-b4a06784def1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3fe5814-dfd2-4bd3-9c32-095f536e3823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3fe5814-dfd2-4bd3-9c32-095f536e3823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-418497415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a430f46-c856-4021-8779-5e554ba099d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bedced91c0c4676b85958d3f30d1d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:14Z,use_quota=True,user_id='a21d7d08a53449dd94e8c4bfbbf5551c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0938810-b9f1-432a-a578-2cf749407f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0938810-b9f1-432a-a578-2cf749407f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549773c0-266f-4c8d-b512-81d8e4594ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549773c0-266f-4c8d-b512-81d8e4594ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a430f46-c856-4021-8779-5e554ba099d5', 'volume_name': 'volume-9a430f46-c856-4021-8779-5e554ba099d5', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82fa2dd-7a51-459f-a440-1b7d93e51fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82fa2dd-7a51-459f-a440-1b7d93e51fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2831ef-9e9f-49f4-af9e-66ba1df334d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:14 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Volume 9a430f46-c856-4021-8779-5e554ba099d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a430f46-c856-4021-8779-5e554ba099d5', 'volume_size': 1} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Flow 'volume_create_manager' (857b9e5d-f548-4989-b3fe-ef3870b6d756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3bc118-09e8-493f-b4cf-949b72812fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3bc118-09e8-493f-b4cf-949b72812fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-299285515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfaf5adc-dda6-47be-962d-ad606ea46c54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bedced91c0c4676b85958d3f30d1d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:15Z,use_quota=True,user_id='a21d7d08a53449dd94e8c4bfbbf5551c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff99abd-f9c2-40f9-9358-3fb8d12045c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff99abd-f9c2-40f9-9358-3fb8d12045c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30602ae3-d4b1-4e7c-b702-c46bb26b1a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30602ae3-d4b1-4e7c-b702-c46bb26b1a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfaf5adc-dda6-47be-962d-ad606ea46c54', 'volume_name': 'volume-bfaf5adc-dda6-47be-962d-ad606ea46c54', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c7c19a-bbea-4ceb-93bf-2d96ba5860bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c7c19a-bbea-4ceb-93bf-2d96ba5860bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a150b1f-971c-4a5c-92d5-04cf43d010e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:14 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Volume bfaf5adc-dda6-47be-962d-ad606ea46c54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfaf5adc-dda6-47be-962d-ad606ea46c54', 'volume_size': 1} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:14 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8bbd9150-4c8c-4d34-98d0-672b16eb1275" returned: 0 in 0.787s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] <== create_volume: return (2061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.073s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.109s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-285842840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6fb0f97-be9d-41db-9110-603249899c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485e8d8fdb3440658f588383c267e9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:06Z,use_quota=True,user_id='0ce9ef6c4083475dba366864ade732ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Creating volume e6fb0f97-be9d-41db-9110-603249899c1f {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:14 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e6fb0f97-be9d-41db-9110-603249899c1f 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:14 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e6fb0f97-be9d-41db-9110-603249899c1f 1073741824 Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fffa5a20-d9b7-4a89-9853-85dd9fa4d847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bbd9150-4c8c-4d34-98d0-672b16eb1275', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:14 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b87946d-781b-423e-9d6f-02f9f4260b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:14 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Volume volume-8bbd9150-4c8c-4d34-98d0-672b16eb1275 (8bbd9150-4c8c-4d34-98d0-672b16eb1275): created successfully Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b87946d-781b-423e-9d6f-02f9f4260b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Flow 'volume_create_manager' (78bfb68b-fc39-492d-a267-40cca46c1b93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:14 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-17a06a83-3946-414a-92be-5fe397d6cb51 tempest-CreateVolumesFromImageTest-1080326515 None] Created volume successfully. Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Flow 'volume_create_manager' (098aad9a-03e7-46a5-b02c-1f3d4869b8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e67d60-d3ee-4e56-ac59-c42e5abb885c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e67d60-d3ee-4e56-ac59-c42e5abb885c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1889275824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e0fad7-e6fd-4d60-bcce-5b5030ec7984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bedced91c0c4676b85958d3f30d1d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:15Z,use_quota=True,user_id='a21d7d08a53449dd94e8c4bfbbf5551c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83118509-7a9f-4c77-a119-682e1d9ece72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83118509-7a9f-4c77-a119-682e1d9ece72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc542245-63bb-4cdb-8fd1-8645814eeae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc542245-63bb-4cdb-8fd1-8645814eeae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71e0fad7-e6fd-4d60-bcce-5b5030ec7984', 'volume_name': 'volume-71e0fad7-e6fd-4d60-bcce-5b5030ec7984', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e8d40c-9a48-48e7-8fb5-782dfc181607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e8d40c-9a48-48e7-8fb5-782dfc181607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9b1fbe-5f88-45a8-bedf-dc9ac7e95f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:15 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Volume 71e0fad7-e6fd-4d60-bcce-5b5030ec7984: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71e0fad7-e6fd-4d60-bcce-5b5030ec7984', 'volume_size': 1} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Flow 'volume_create_manager' (6f8bdc8f-9ab1-4499-aef8-aaed4a34aad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7aa872-916c-4062-9f2f-4b05529d12c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7aa872-916c-4062-9f2f-4b05529d12c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1119741027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81550649-3246-4325-ad82-5824838686c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bedced91c0c4676b85958d3f30d1d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:15Z,use_quota=True,user_id='a21d7d08a53449dd94e8c4bfbbf5551c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8657bb1b-4c14-46d2-9d5e-8425d36b1fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8657bb1b-4c14-46d2-9d5e-8425d36b1fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11aaf33d-dd13-4b16-9d5d-c674cd6259c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11aaf33d-dd13-4b16-9d5d-c674cd6259c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81550649-3246-4325-ad82-5824838686c0', 'volume_name': 'volume-81550649-3246-4325-ad82-5824838686c0', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96177446-c959-465d-b088-ad71d9ef029d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96177446-c959-465d-b088-ad71d9ef029d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff8f7823-d588-4193-bf30-f0f935a1b8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:15 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Volume 81550649-3246-4325-ad82-5824838686c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81550649-3246-4325-ad82-5824838686c0', 'volume_size': 1} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:15 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e6fb0f97-be9d-41db-9110-603249899c1f 1073741824" returned: 0 in 1.014s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e6fb0f97-be9d-41db-9110-603249899c1f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:15 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e6fb0f97-be9d-41db-9110-603249899c1f Jul 07 17:41:15 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:16 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e6fb0f97-be9d-41db-9110-603249899c1f" returned: 0 in 0.700s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:16 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.493s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:16 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2039458962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7192f8-cdf4-40bb-a187-31d8ad12d7d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485e8d8fdb3440658f588383c267e9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:07Z,use_quota=True,user_id='0ce9ef6c4083475dba366864ade732ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:16 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Creating volume bf7192f8-cdf4-40bb-a187-31d8ad12d7d4 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:16 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:16 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:16 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:16 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:41:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bf7192f8-cdf4-40bb-a187-31d8ad12d7d4 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067fb672-d8e2-4aeb-9262-18cce8e62a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6fb0f97-be9d-41db-9110-603249899c1f', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:16 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bf7192f8-cdf4-40bb-a187-31d8ad12d7d4 1073741824 Jul 07 17:41:16 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083ea9a8-6410-46af-ac88-7970164b33c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:16 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Volume volume-e6fb0f97-be9d-41db-9110-603249899c1f (e6fb0f97-be9d-41db-9110-603249899c1f): created successfully Jul 07 17:41:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083ea9a8-6410-46af-ac88-7970164b33c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Flow 'volume_create_manager' (168a4908-17b1-4493-bef4-354195250dcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:16 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-32479664-f611-456e-854e-411682913531 tempest-CreateVolumesFromImageTest-1080326515 None] Created volume successfully. Jul 07 17:41:17 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bf7192f8-cdf4-40bb-a187-31d8ad12d7d4 1073741824" returned: 0 in 0.889s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bf7192f8-cdf4-40bb-a187-31d8ad12d7d4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:17 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bf7192f8-cdf4-40bb-a187-31d8ad12d7d4 Jul 07 17:41:17 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:18 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bf7192f8-cdf4-40bb-a187-31d8ad12d7d4" returned: 0 in 0.695s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:18 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e4f4ad3c-7ebf-4711-9db3-387b8c88fcc1 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.115s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72109b86-7609-4845-a266-281db05be0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf7192f8-cdf4-40bb-a187-31d8ad12d7d4', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae84156b-c2cf-41e1-8e90-72b0730dd96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:18 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e4f4ad3c-7ebf-4711-9db3-387b8c88fcc1 tempest-CreateVolumesFromSnapshotTest-116157209 None] Creating offline snapshot 8c03a725-6124-492c-8de0-5ecf6a0cae66 of volume 84642159-1f24-472c-8464-50bd509bc4d3 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:41:18 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Volume volume-bf7192f8-cdf4-40bb-a187-31d8ad12d7d4 (bf7192f8-cdf4-40bb-a187-31d8ad12d7d4): created successfully Jul 07 17:41:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae84156b-c2cf-41e1-8e90-72b0730dd96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Flow 'volume_create_manager' (967b653f-88ec-4329-b6d5-4cdfb59cee9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:18 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc2966d-5d6a-4c80-b422-c515f1b97a5a]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e4f4ad3c-7ebf-4711-9db3-387b8c88fcc1 tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:18 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-631df121-8cd3-4031-ae0e-d29ad3878b02 tempest-CreateVolumesFromImageTest-1080326515 None] Created volume successfully. Jul 07 17:41:18 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3 Jul 07 17:41:18 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:19 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e4f4ad3c-7ebf-4711-9db3-387b8c88fcc1 tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3" returned: 0 in 0.802s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e4f4ad3c-7ebf-4711-9db3-387b8c88fcc1 tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.8c03a725-6124-492c-8de0-5ecf6a0cae66 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:19 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.8c03a725-6124-492c-8de0-5ecf6a0cae66 1G Jul 07 17:41:19 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4b475894-9a95-4f12-aced-dab39d7b373f tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "cinder-bf7192f8-cdf4-40bb-a187-31d8ad12d7d4-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4b475894-9a95-4f12-aced-dab39d7b373f tempest-CreateVolumesFromImageTest-1080326515 None] Lock "cinder-bf7192f8-cdf4-40bb-a187-31d8ad12d7d4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4b475894-9a95-4f12-aced-dab39d7b373f tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "cinder-quobyte-bf7192f8-cdf4-40bb-a187-31d8ad12d7d4" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4b475894-9a95-4f12-aced-dab39d7b373f tempest-CreateVolumesFromImageTest-1080326515 None] Lock "cinder-quobyte-bf7192f8-cdf4-40bb-a187-31d8ad12d7d4" acquired by "delete_volume" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:19 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[382df764-8e8a-447a-ba0b-9d518e326c74]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4b475894-9a95-4f12-aced-dab39d7b373f tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bf7192f8-cdf4-40bb-a187-31d8ad12d7d4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:19 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bf7192f8-cdf4-40bb-a187-31d8ad12d7d4 Jul 07 17:41:19 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:19 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e4f4ad3c-7ebf-4711-9db3-387b8c88fcc1 tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.8c03a725-6124-492c-8de0-5ecf6a0cae66 1G" returned: 0 in 0.916s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e4f4ad3c-7ebf-4711-9db3-387b8c88fcc1 tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84642159-1f24-472c-8464-50bd509bc4d3 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.8c03a725-6124-492c-8de0-5ecf6a0cae66 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:19 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84642159-1f24-472c-8464-50bd509bc4d3 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.8c03a725-6124-492c-8de0-5ecf6a0cae66 Jul 07 17:41:20 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:20 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4b475894-9a95-4f12-aced-dab39d7b373f tempest-CreateVolumesFromImageTest-1080326515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bf7192f8-cdf4-40bb-a187-31d8ad12d7d4" returned: 0 in 0.852s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4b475894-9a95-4f12-aced-dab39d7b373f tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bf7192f8-cdf4-40bb-a187-31d8ad12d7d4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:20 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bf7192f8-cdf4-40bb-a187-31d8ad12d7d4 Jul 07 17:41:20 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:20 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e4f4ad3c-7ebf-4711-9db3-387b8c88fcc1 tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84642159-1f24-472c-8464-50bd509bc4d3 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.8c03a725-6124-492c-8de0-5ecf6a0cae66" returned: 0 in 0.792s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:20 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-e4f4ad3c-7ebf-4711-9db3-387b8c88fcc1 tempest-CreateVolumesFromSnapshotTest-116157209 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.8c03a725-6124-492c-8de0-5ecf6a0cae66 is being set with open permissions: ugo+rw Jul 07 17:41:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e4f4ad3c-7ebf-4711-9db3-387b8c88fcc1 tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.8c03a725-6124-492c-8de0-5ecf6a0cae66 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:20 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.8c03a725-6124-492c-8de0-5ecf6a0cae66 Jul 07 17:41:20 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:20 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4b475894-9a95-4f12-aced-dab39d7b373f tempest-CreateVolumesFromImageTest-1080326515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bf7192f8-cdf4-40bb-a187-31d8ad12d7d4" returned: 0 in 0.725s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4b475894-9a95-4f12-aced-dab39d7b373f tempest-CreateVolumesFromImageTest-1080326515 None] Lock "cinder-quobyte-bf7192f8-cdf4-40bb-a187-31d8ad12d7d4" released by "delete_volume" :: held 1.632s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:20 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-4b475894-9a95-4f12-aced-dab39d7b373f tempest-CreateVolumesFromImageTest-1080326515 None] Created reservations ['052496ef-de75-4942-b156-6147d4fda849', 'f057ee6d-a873-4672-b4d9-2093d5bd6945', '0e524ed3-e28c-4025-b401-c6a619c28f38', '733ac07c-992b-41f3-b0a7-0705b7bbb603'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4b475894-9a95-4f12-aced-dab39d7b373f tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4b475894-9a95-4f12-aced-dab39d7b373f tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4b475894-9a95-4f12-aced-dab39d7b373f tempest-CreateVolumesFromImageTest-1080326515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4b475894-9a95-4f12-aced-dab39d7b373f tempest-CreateVolumesFromImageTest-1080326515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4b475894-9a95-4f12-aced-dab39d7b373f tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4b475894-9a95-4f12-aced-dab39d7b373f tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:21 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:41:21 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-be81dd36-feb6-4607-942f-0827a20e2bf1 tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "cinder-e6fb0f97-be9d-41db-9110-603249899c1f-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-be81dd36-feb6-4607-942f-0827a20e2bf1 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "cinder-e6fb0f97-be9d-41db-9110-603249899c1f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-be81dd36-feb6-4607-942f-0827a20e2bf1 tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "cinder-quobyte-e6fb0f97-be9d-41db-9110-603249899c1f" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-be81dd36-feb6-4607-942f-0827a20e2bf1 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "cinder-quobyte-e6fb0f97-be9d-41db-9110-603249899c1f" acquired by "delete_volume" :: waited 0.024s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:21 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[565234fc-344e-477b-b8a9-954de413824c]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-be81dd36-feb6-4607-942f-0827a20e2bf1 tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e6fb0f97-be9d-41db-9110-603249899c1f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:21 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e4f4ad3c-7ebf-4711-9db3-387b8c88fcc1 tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.8c03a725-6124-492c-8de0-5ecf6a0cae66" returned: 0 in 0.833s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e4f4ad3c-7ebf-4711-9db3-387b8c88fcc1 tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:21 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.info Jul 07 17:41:21 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:21 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e6fb0f97-be9d-41db-9110-603249899c1f Jul 07 17:41:21 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:21 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4b475894-9a95-4f12-aced-dab39d7b373f tempest-CreateVolumesFromImageTest-1080326515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.798s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:21 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-4b475894-9a95-4f12-aced-dab39d7b373f tempest-CreateVolumesFromImageTest-1080326515 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:21 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-4b475894-9a95-4f12-aced-dab39d7b373f tempest-CreateVolumesFromImageTest-1080326515 None] Deleted volume successfully. Jul 07 17:41:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4b475894-9a95-4f12-aced-dab39d7b373f tempest-CreateVolumesFromImageTest-1080326515 None] Lock "cinder-bf7192f8-cdf4-40bb-a187-31d8ad12d7d4-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:22 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e4f4ad3c-7ebf-4711-9db3-387b8c88fcc1 tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.info" returned: 0 in 0.843s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:22 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-e4f4ad3c-7ebf-4711-9db3-387b8c88fcc1 tempest-CreateVolumesFromSnapshotTest-116157209 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.info is being set with open permissions: ugo+rw Jul 07 17:41:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e4f4ad3c-7ebf-4711-9db3-387b8c88fcc1 tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:22 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.info Jul 07 17:41:22 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:22 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-be81dd36-feb6-4607-942f-0827a20e2bf1 tempest-CreateVolumesFromImageTest-1080326515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e6fb0f97-be9d-41db-9110-603249899c1f" returned: 0 in 1.025s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-be81dd36-feb6-4607-942f-0827a20e2bf1 tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e6fb0f97-be9d-41db-9110-603249899c1f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:22 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e6fb0f97-be9d-41db-9110-603249899c1f Jul 07 17:41:22 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:23 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e4f4ad3c-7ebf-4711-9db3-387b8c88fcc1 tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.info" returned: 0 in 0.741s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e4f4ad3c-7ebf-4711-9db3-387b8c88fcc1 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.083s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.073s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:23 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3827babc-d397-42d4-9aa0-20df38790a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d80fa0f78ef4ede945be5ae93eded2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:09Z,use_quota=True,user_id='b4187a31fa534cd19d1a77440fc452e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f338934-b74a-4e97-b7bd-ff2ea26024bb),volume_type_id=5f338934-b74a-4e97-b7bd-ff2ea26024bb)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Creating volume 3827babc-d397-42d4-9aa0-20df38790a05 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:23 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-be81dd36-feb6-4607-942f-0827a20e2bf1 tempest-CreateVolumesFromImageTest-1080326515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e6fb0f97-be9d-41db-9110-603249899c1f" returned: 0 in 0.739s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:23 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05 1073741824 Jul 07 17:41:23 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-be81dd36-feb6-4607-942f-0827a20e2bf1 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "cinder-quobyte-e6fb0f97-be9d-41db-9110-603249899c1f" released by "delete_volume" :: held 1.832s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:23 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-e4f4ad3c-7ebf-4711-9db3-387b8c88fcc1 tempest-CreateVolumesFromSnapshotTest-116157209 None] Create snapshot completed successfully Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-be81dd36-feb6-4607-942f-0827a20e2bf1 tempest-CreateVolumesFromImageTest-1080326515 None] Created reservations ['52a326fd-2397-48ef-89ce-1e5a534018ce', '962607d7-00c7-4a91-a4dd-91cb03cfc6de', 'ff707fe5-d5b1-454a-b74a-678930d61873', '9339bd64-9a52-4989-a7ec-f37e210c1399'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-be81dd36-feb6-4607-942f-0827a20e2bf1 tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-be81dd36-feb6-4607-942f-0827a20e2bf1 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-be81dd36-feb6-4607-942f-0827a20e2bf1 tempest-CreateVolumesFromImageTest-1080326515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-be81dd36-feb6-4607-942f-0827a20e2bf1 tempest-CreateVolumesFromImageTest-1080326515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-be81dd36-feb6-4607-942f-0827a20e2bf1 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-be81dd36-feb6-4607-942f-0827a20e2bf1 tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:23 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:41:23 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2a08fc74-117c-4a58-a268-d0aa868256f5 tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "cinder-8bbd9150-4c8c-4d34-98d0-672b16eb1275-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2a08fc74-117c-4a58-a268-d0aa868256f5 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "cinder-8bbd9150-4c8c-4d34-98d0-672b16eb1275-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2a08fc74-117c-4a58-a268-d0aa868256f5 tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "cinder-quobyte-8bbd9150-4c8c-4d34-98d0-672b16eb1275" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2a08fc74-117c-4a58-a268-d0aa868256f5 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "cinder-quobyte-8bbd9150-4c8c-4d34-98d0-672b16eb1275" acquired by "delete_volume" :: waited 0.026s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ab818b-5ed0-4903-b5f4-c7db20ff10d2]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a08fc74-117c-4a58-a268-d0aa868256f5 tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8bbd9150-4c8c-4d34-98d0-672b16eb1275 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:24 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8bbd9150-4c8c-4d34-98d0-672b16eb1275 Jul 07 17:41:24 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:24 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-be81dd36-feb6-4607-942f-0827a20e2bf1 tempest-CreateVolumesFromImageTest-1080326515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.935s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:24 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-be81dd36-feb6-4607-942f-0827a20e2bf1 tempest-CreateVolumesFromImageTest-1080326515 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:24 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-be81dd36-feb6-4607-942f-0827a20e2bf1 tempest-CreateVolumesFromImageTest-1080326515 None] Deleted volume successfully. Jul 07 17:41:24 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Flow 'volume_create_manager' (8edebd35-d924-4887-8420-7d031d439cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18203b6-7e02-466a-9ad6-7368d1d64a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18203b6-7e02-466a-9ad6-7368d1d64a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1289698493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26d9838-0538-46b4-935c-c29bcc7967a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f90b720b394234bf3dd532abef92e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:24Z,use_quota=True,user_id='bc83121ff3b3407c97024246f349b048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5465e55-f5cf-41d6-ba64-c5eacacca2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5465e55-f5cf-41d6-ba64-c5eacacca2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dbf0c72-70da-4548-b36a-a607650b47fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dbf0c72-70da-4548-b36a-a607650b47fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b26d9838-0538-46b4-935c-c29bcc7967a3', 'volume_name': 'volume-b26d9838-0538-46b4-935c-c29bcc7967a3', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:24 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df8e55e4-892a-4053-b253-f41a65487a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df8e55e4-892a-4053-b253-f41a65487a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (742ab0c5-9b3e-4f92-834e-53e162729f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:24 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Volume b26d9838-0538-46b4-935c-c29bcc7967a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b26d9838-0538-46b4-935c-c29bcc7967a3', 'volume_size': 1} Jul 07 17:41:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05 1073741824" returned: 0 in 1.301s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-be81dd36-feb6-4607-942f-0827a20e2bf1 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "cinder-e6fb0f97-be9d-41db-9110-603249899c1f-delete_volume" released by "delete_volume" :: held 3.182s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:24 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05 Jul 07 17:41:24 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:24 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Flow 'volume_create_manager' (0eaa4e6c-2064-49c4-9d70-3bedd577bd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d166c8c7-257e-437d-8b51-734b8f94e0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d166c8c7-257e-437d-8b51-734b8f94e0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1362742754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5026e4fa-826d-4589-854e-4446069a1c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f90b720b394234bf3dd532abef92e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:25Z,use_quota=True,user_id='bc83121ff3b3407c97024246f349b048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2931fbd-642d-4344-af76-8ebaec65c3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2931fbd-642d-4344-af76-8ebaec65c3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:25 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d05f1f-3590-4b11-97e9-d9b29c06bd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d05f1f-3590-4b11-97e9-d9b29c06bd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5026e4fa-826d-4589-854e-4446069a1c6f', 'volume_name': 'volume-5026e4fa-826d-4589-854e-4446069a1c6f', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4699c5-c782-4db3-9449-701abb11c1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4699c5-c782-4db3-9449-701abb11c1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc01a851-60f7-48e4-9dfd-9a13d9f79164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:25 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Volume 5026e4fa-826d-4589-854e-4446069a1c6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5026e4fa-826d-4589-854e-4446069a1c6f', 'volume_size': 1} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a08fc74-117c-4a58-a268-d0aa868256f5 tempest-CreateVolumesFromImageTest-1080326515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8bbd9150-4c8c-4d34-98d0-672b16eb1275" returned: 0 in 1.293s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a08fc74-117c-4a58-a268-d0aa868256f5 tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8bbd9150-4c8c-4d34-98d0-672b16eb1275 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:25 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8bbd9150-4c8c-4d34-98d0-672b16eb1275 Jul 07 17:41:25 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Flow 'volume_create_manager' (11773370-048e-4c69-b655-b055109331d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adfb623a-0cf6-47ea-9dce-0225e59506af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adfb623a-0cf6-47ea-9dce-0225e59506af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1640362358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f90b720b394234bf3dd532abef92e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:25Z,use_quota=True,user_id='bc83121ff3b3407c97024246f349b048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c2afee-8cdb-4cc1-8dfe-6d36f8734c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c2afee-8cdb-4cc1-8dfe-6d36f8734c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b77b0dd-c7de-40ed-afa4-0d14ac825488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b77b0dd-c7de-40ed-afa4-0d14ac825488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8', 'volume_name': 'volume-c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e32525-fe74-4818-bd08-da61a5d0cd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e32525-fe74-4818-bd08-da61a5d0cd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b71c3d5-644a-4941-b512-8abc7d29aac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:25 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Volume c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8', 'volume_size': 1} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:25 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05" returned: 0 in 1.036s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] <== create_volume: return (2399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.406s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.927s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-847931118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e87768-66e2-4e1d-b53a-505ec5d3d081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bedced91c0c4676b85958d3f30d1d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:14Z,use_quota=True,user_id='a21d7d08a53449dd94e8c4bfbbf5551c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Creating volume e4e87768-66e2-4e1d-b53a-505ec5d3d081 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:25 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e4e87768-66e2-4e1d-b53a-505ec5d3d081 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:25 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e4e87768-66e2-4e1d-b53a-505ec5d3d081 1073741824 Jul 07 17:41:25 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Attempting download of 6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b ((None, [{'url': 'file:///opt/stack/data/glance/images/6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b', 'metadata': {}}])) to volume 3827babc-d397-42d4-9aa0-20df38790a05. {{(pid=87303) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[767d6b08-a7cf-46bc-93e2-8b1889804bdd]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b__f3r3eeu {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Flow 'volume_create_manager' (ba87ea28-852f-40b3-9206-9ff99fb05dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:26 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b__f3r3eeu Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e492aec-c078-4687-87f0-b5ab4de72973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:26 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:26 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e492aec-c078-4687-87f0-b5ab4de72973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1706928049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4614c83-f783-4eba-9908-fc532883d133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f90b720b394234bf3dd532abef92e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:26Z,use_quota=True,user_id='bc83121ff3b3407c97024246f349b048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26470757-790f-40c1-914c-b70b933a4f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26470757-790f-40c1-914c-b70b933a4f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eded92e5-5ba0-4d95-814d-301e3cbfef21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eded92e5-5ba0-4d95-814d-301e3cbfef21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4614c83-f783-4eba-9908-fc532883d133', 'volume_name': 'volume-f4614c83-f783-4eba-9908-fc532883d133', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549d42e1-7906-4f7b-a03e-1545922779b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549d42e1-7906-4f7b-a03e-1545922779b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b452787-938e-4437-b249-71a663bb79a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:26 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Volume f4614c83-f783-4eba-9908-fc532883d133: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4614c83-f783-4eba-9908-fc532883d133', 'volume_size': 1} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a08fc74-117c-4a58-a268-d0aa868256f5 tempest-CreateVolumesFromImageTest-1080326515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8bbd9150-4c8c-4d34-98d0-672b16eb1275" returned: 0 in 1.039s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2a08fc74-117c-4a58-a268-d0aa868256f5 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "cinder-quobyte-8bbd9150-4c8c-4d34-98d0-672b16eb1275" released by "delete_volume" :: held 2.397s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-2a08fc74-117c-4a58-a268-d0aa868256f5 tempest-CreateVolumesFromImageTest-1080326515 None] Created reservations ['293b2515-398e-4e37-a421-a5f6e0870fd3', 'f42ddbad-fec6-4c3d-b803-f0eb6054e0af', 'f7cd3a7c-22f0-445f-ac88-5ee9be3e0401', 'dc7e5ddc-f09d-406f-9958-ac54ce1013aa'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-2a08fc74-117c-4a58-a268-d0aa868256f5 tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-2a08fc74-117c-4a58-a268-d0aa868256f5 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-2a08fc74-117c-4a58-a268-d0aa868256f5 tempest-CreateVolumesFromImageTest-1080326515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-2a08fc74-117c-4a58-a268-d0aa868256f5 tempest-CreateVolumesFromImageTest-1080326515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-2a08fc74-117c-4a58-a268-d0aa868256f5 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a08fc74-117c-4a58-a268-d0aa868256f5 tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:26 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:41:26 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Flow 'volume_create_manager' (4d76ca7e-8654-4888-9f03-567226224109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a68dc27-13dd-4386-93e7-80bca449fe4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a68dc27-13dd-4386-93e7-80bca449fe4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-531008494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3605d0bd-91c8-4eaa-86b2-a199249b292d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f90b720b394234bf3dd532abef92e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:27Z,use_quota=True,user_id='bc83121ff3b3407c97024246f349b048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dedb1607-44fa-4127-892c-c41355148ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dedb1607-44fa-4127-892c-c41355148ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d91a4c-2e22-40dd-b294-ac352dca9394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d91a4c-2e22-40dd-b294-ac352dca9394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3605d0bd-91c8-4eaa-86b2-a199249b292d', 'volume_name': 'volume-3605d0bd-91c8-4eaa-86b2-a199249b292d', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ab66b6-7b49-4331-bcf0-b2d3d496b1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ab66b6-7b49-4331-bcf0-b2d3d496b1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c797d43-4100-4d98-a85e-202e435aa372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:26 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Volume 3605d0bd-91c8-4eaa-86b2-a199249b292d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3605d0bd-91c8-4eaa-86b2-a199249b292d', 'volume_size': 1} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:26 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b__f3r3eeu" returned: 0 in 1.090s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b__f3r3eeu {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:26 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e4e87768-66e2-4e1d-b53a-505ec5d3d081 1073741824" returned: 0 in 1.249s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e4e87768-66e2-4e1d-b53a-505ec5d3d081 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:27 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e4e87768-66e2-4e1d-b53a-505ec5d3d081 Jul 07 17:41:27 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:27 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b__f3r3eeu Jul 07 17:41:27 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-651357bf-0a56-44e1-ad8f-e86def89efed tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "cinder-d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-651357bf-0a56-44e1-ad8f-e86def89efed tempest-CreateVolumesFromImageTest-1080326515 None] Lock "cinder-d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:27 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a08fc74-117c-4a58-a268-d0aa868256f5 tempest-CreateVolumesFromImageTest-1080326515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.930s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:27 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-2a08fc74-117c-4a58-a268-d0aa868256f5 tempest-CreateVolumesFromImageTest-1080326515 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:27 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-2a08fc74-117c-4a58-a268-d0aa868256f5 tempest-CreateVolumesFromImageTest-1080326515 None] Deleted volume successfully. Jul 07 17:41:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-651357bf-0a56-44e1-ad8f-e86def89efed tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "cinder-quobyte-d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2a08fc74-117c-4a58-a268-d0aa868256f5 tempest-CreateVolumesFromImageTest-1080326515 None] Lock "cinder-8bbd9150-4c8c-4d34-98d0-672b16eb1275-delete_volume" released by "delete_volume" :: held 3.660s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-651357bf-0a56-44e1-ad8f-e86def89efed tempest-CreateVolumesFromImageTest-1080326515 None] Lock "cinder-quobyte-d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0" acquired by "delete_volume" :: waited 0.028s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:27 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fe044c-697d-4078-ad79-24b0579d4d11]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-651357bf-0a56-44e1-ad8f-e86def89efed tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:27 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0 Jul 07 17:41:27 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:27 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b__f3r3eeu" returned: 1 in 0.967s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b__f3r3eeu' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:41:27 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e3c094-4fe1-46f3-92a5-052ea3b88413]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:27 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e4e87768-66e2-4e1d-b53a-505ec5d3d081" returned: 0 in 1.004s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] <== create_volume: return (2314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.317s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.733s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-418497415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a430f46-c856-4021-8779-5e554ba099d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bedced91c0c4676b85958d3f30d1d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:14Z,use_quota=True,user_id='a21d7d08a53449dd94e8c4bfbbf5551c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Creating volume 9a430f46-c856-4021-8779-5e554ba099d5 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:28 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD Jul 07 17:41:28 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:28 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:41:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9a430f46-c856-4021-8779-5e554ba099d5 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:28 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9a430f46-c856-4021-8779-5e554ba099d5 1073741824 Jul 07 17:41:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c58af4-6640-412d-8aef-99d1934195fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4e87768-66e2-4e1d-b53a-505ec5d3d081', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:28 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d9891b-a777-428b-b924-551bad451f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:28 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Volume volume-e4e87768-66e2-4e1d-b53a-505ec5d3d081 (e4e87768-66e2-4e1d-b53a-505ec5d3d081): created successfully Jul 07 17:41:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d9891b-a777-428b-b924-551bad451f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Flow 'volume_create_manager' (16f9126d-68b5-425a-b9d9-868f48236979) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:28 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-1f61cb5a-e703-4877-b066-5838412d404e tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Created volume successfully. Jul 07 17:41:28 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-651357bf-0a56-44e1-ad8f-e86def89efed tempest-CreateVolumesFromImageTest-1080326515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0" returned: 0 in 0.858s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-651357bf-0a56-44e1-ad8f-e86def89efed tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:28 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0 Jul 07 17:41:28 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:28 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD" returned: 0 in 0.861s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:28 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD Jul 07 17:41:28 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:29 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9a430f46-c856-4021-8779-5e554ba099d5 1073741824" returned: 0 in 1.018s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:29 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-651357bf-0a56-44e1-ad8f-e86def89efed tempest-CreateVolumesFromImageTest-1080326515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0" returned: 0 in 0.778s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-651357bf-0a56-44e1-ad8f-e86def89efed tempest-CreateVolumesFromImageTest-1080326515 None] Lock "cinder-quobyte-d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0" released by "delete_volume" :: held 1.694s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9a430f46-c856-4021-8779-5e554ba099d5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:29 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9a430f46-c856-4021-8779-5e554ba099d5 Jul 07 17:41:29 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:29 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-651357bf-0a56-44e1-ad8f-e86def89efed tempest-CreateVolumesFromImageTest-1080326515 None] Created reservations ['e072a361-65e5-4a8c-b77e-04677b2354e0', 'f74b6a58-068c-400a-a240-87d28560a79c', 'c30fbb9d-af7c-4a58-8429-8b305f63fbed', 'aef5e165-b534-4568-a054-9613e5369633'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-651357bf-0a56-44e1-ad8f-e86def89efed tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-651357bf-0a56-44e1-ad8f-e86def89efed tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-651357bf-0a56-44e1-ad8f-e86def89efed tempest-CreateVolumesFromImageTest-1080326515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-651357bf-0a56-44e1-ad8f-e86def89efed tempest-CreateVolumesFromImageTest-1080326515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-651357bf-0a56-44e1-ad8f-e86def89efed tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-651357bf-0a56-44e1-ad8f-e86def89efed tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:29 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:41:29 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-869dfefb-df3e-4a5b-844a-408d5c4eba8a tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "cinder-3d91d5bf-887f-4ba0-a855-7b4a7465eaef-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-869dfefb-df3e-4a5b-844a-408d5c4eba8a tempest-CreateVolumesFromImageTest-1080326515 None] Lock "cinder-3d91d5bf-887f-4ba0-a855-7b4a7465eaef-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:29 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD" returned: 1 in 0.927s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:41:29 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] 6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b was raw, converting to raw {{(pid=87303) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:41:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:29 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05 Jul 07 17:41:29 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-869dfefb-df3e-4a5b-844a-408d5c4eba8a tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "cinder-quobyte-3d91d5bf-887f-4ba0-a855-7b4a7465eaef" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-869dfefb-df3e-4a5b-844a-408d5c4eba8a tempest-CreateVolumesFromImageTest-1080326515 None] Lock "cinder-quobyte-3d91d5bf-887f-4ba0-a855-7b4a7465eaef" acquired by "delete_volume" :: waited 0.032s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:29 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efb39e8-f0bb-4234-88ee-590c17ff0d2b]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-869dfefb-df3e-4a5b-844a-408d5c4eba8a tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d91d5bf-887f-4ba0-a855-7b4a7465eaef {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:29 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d91d5bf-887f-4ba0-a855-7b4a7465eaef Jul 07 17:41:29 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:30 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-651357bf-0a56-44e1-ad8f-e86def89efed tempest-CreateVolumesFromImageTest-1080326515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.789s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-651357bf-0a56-44e1-ad8f-e86def89efed tempest-CreateVolumesFromImageTest-1080326515 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:30 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-651357bf-0a56-44e1-ad8f-e86def89efed tempest-CreateVolumesFromImageTest-1080326515 None] Deleted volume successfully. Jul 07 17:41:30 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9a430f46-c856-4021-8779-5e554ba099d5" returned: 0 in 0.954s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.383s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-299285515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfaf5adc-dda6-47be-962d-ad606ea46c54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bedced91c0c4676b85958d3f30d1d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:15Z,use_quota=True,user_id='a21d7d08a53449dd94e8c4bfbbf5551c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Creating volume bfaf5adc-dda6-47be-962d-ad606ea46c54 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:30 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bfaf5adc-dda6-47be-962d-ad606ea46c54 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:30 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bfaf5adc-dda6-47be-962d-ad606ea46c54 1073741824 Jul 07 17:41:30 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-651357bf-0a56-44e1-ad8f-e86def89efed tempest-CreateVolumesFromImageTest-1080326515 None] Lock "cinder-d2fef09a-3bbd-4a32-8dfb-9ecc08bab5b0-delete_volume" released by "delete_volume" :: held 2.903s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2831ef-9e9f-49f4-af9e-66ba1df334d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a430f46-c856-4021-8779-5e554ba099d5', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30714b4a-85b1-45ca-9807-c76d2c94e9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:30 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Volume volume-9a430f46-c856-4021-8779-5e554ba099d5 (9a430f46-c856-4021-8779-5e554ba099d5): created successfully Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30714b4a-85b1-45ca-9807-c76d2c94e9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Flow 'volume_create_manager' (4d985971-ae38-4f1f-9492-b4a06784def1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:30 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-0fb4729d-6db5-494f-a2cb-6fc7b1170294 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Created volume successfully. Jul 07 17:41:30 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05" returned: 0 in 0.944s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b_rs7re54hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05 {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:41:30 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:30 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05 1G Jul 07 17:41:30 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:30 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-869dfefb-df3e-4a5b-844a-408d5c4eba8a tempest-CreateVolumesFromImageTest-1080326515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d91d5bf-887f-4ba0-a855-7b4a7465eaef" returned: 0 in 0.881s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-869dfefb-df3e-4a5b-844a-408d5c4eba8a tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d91d5bf-887f-4ba0-a855-7b4a7465eaef {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:30 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d91d5bf-887f-4ba0-a855-7b4a7465eaef Jul 07 17:41:30 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:31 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bfaf5adc-dda6-47be-962d-ad606ea46c54 1073741824" returned: 0 in 1.117s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bfaf5adc-dda6-47be-962d-ad606ea46c54 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:31 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bfaf5adc-dda6-47be-962d-ad606ea46c54 Jul 07 17:41:31 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:31 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-869dfefb-df3e-4a5b-844a-408d5c4eba8a tempest-CreateVolumesFromImageTest-1080326515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3d91d5bf-887f-4ba0-a855-7b4a7465eaef" returned: 0 in 0.787s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:31 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05 1G" returned: 0 in 0.887s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-869dfefb-df3e-4a5b-844a-408d5c4eba8a tempest-CreateVolumesFromImageTest-1080326515 None] Lock "cinder-quobyte-3d91d5bf-887f-4ba0-a855-7b4a7465eaef" released by "delete_volume" :: held 1.754s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:31 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[851c267d-1e83-4890-a1c1-fdbe5d2e2e2c]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:31 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-869dfefb-df3e-4a5b-844a-408d5c4eba8a tempest-CreateVolumesFromImageTest-1080326515 None] Created reservations ['4eb0dbdd-c7e1-4818-9d7d-08629701d9ff', '50bf73e3-dad3-4524-868d-08c7aa9726c5', '360a8657-7f8b-47aa-85c5-14691ab55845', '90db4e26-b0cf-49dd-81b2-0215b27941ff'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-869dfefb-df3e-4a5b-844a-408d5c4eba8a tempest-CreateVolumesFromImageTest-1080326515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-869dfefb-df3e-4a5b-844a-408d5c4eba8a tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-869dfefb-df3e-4a5b-844a-408d5c4eba8a tempest-CreateVolumesFromImageTest-1080326515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-869dfefb-df3e-4a5b-844a-408d5c4eba8a tempest-CreateVolumesFromImageTest-1080326515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-869dfefb-df3e-4a5b-844a-408d5c4eba8a tempest-CreateVolumesFromImageTest-1080326515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:31 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05 Jul 07 17:41:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-869dfefb-df3e-4a5b-844a-408d5c4eba8a tempest-CreateVolumesFromImageTest-1080326515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:31 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:31 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:41:31 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:32 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bfaf5adc-dda6-47be-962d-ad606ea46c54" returned: 0 in 0.800s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.927s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1889275824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e0fad7-e6fd-4d60-bcce-5b5030ec7984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bedced91c0c4676b85958d3f30d1d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:15Z,use_quota=True,user_id='a21d7d08a53449dd94e8c4bfbbf5551c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Creating volume 71e0fad7-e6fd-4d60-bcce-5b5030ec7984 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:32 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:41:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-71e0fad7-e6fd-4d60-bcce-5b5030ec7984 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a150b1f-971c-4a5c-92d5-04cf43d010e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfaf5adc-dda6-47be-962d-ad606ea46c54', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:32 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-71e0fad7-e6fd-4d60-bcce-5b5030ec7984 1073741824 Jul 07 17:41:32 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f2729c8-f7c9-4fb8-b7d6-06c5c3c57de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:32 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Volume volume-bfaf5adc-dda6-47be-962d-ad606ea46c54 (bfaf5adc-dda6-47be-962d-ad606ea46c54): created successfully Jul 07 17:41:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f2729c8-f7c9-4fb8-b7d6-06c5c3c57de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Flow 'volume_create_manager' (857b9e5d-f548-4989-b3fe-ef3870b6d756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:32 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-0227733e-ccc9-44bc-8d83-c2b9768c1dd7 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Created volume successfully. Jul 07 17:41:32 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-869dfefb-df3e-4a5b-844a-408d5c4eba8a tempest-CreateVolumesFromImageTest-1080326515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.849s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:32 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-869dfefb-df3e-4a5b-844a-408d5c4eba8a tempest-CreateVolumesFromImageTest-1080326515 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:32 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-869dfefb-df3e-4a5b-844a-408d5c4eba8a tempest-CreateVolumesFromImageTest-1080326515 None] Deleted volume successfully. Jul 07 17:41:32 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-869dfefb-df3e-4a5b-844a-408d5c4eba8a tempest-CreateVolumesFromImageTest-1080326515 None] Lock "cinder-3d91d5bf-887f-4ba0-a855-7b4a7465eaef-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:32 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05" returned: 0 in 1.085s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:32 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05 Jul 07 17:41:32 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:33 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-71e0fad7-e6fd-4d60-bcce-5b5030ec7984 1073741824" returned: 0 in 1.349s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-71e0fad7-e6fd-4d60-bcce-5b5030ec7984 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:33 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-71e0fad7-e6fd-4d60-bcce-5b5030ec7984 Jul 07 17:41:33 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:33 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05" returned: 1 in 1.026s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:41:33 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Downloaded image 6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b ((None, [{'url': 'file:///opt/stack/data/glance/images/6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b', 'metadata': {}}])) to volume 3827babc-d397-42d4-9aa0-20df38790a05 successfully. {{(pid=87303) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:41:33 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Temporary image 6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b for user b4187a31fa534cd19d1a77440fc452e7 is deleted. {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:41:33 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Marking volume 3827babc-d397-42d4-9aa0-20df38790a05 as bootable. {{(pid=87303) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:41:33 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Copying metadata from image 6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b to 3827babc-d397-42d4-9aa0-20df38790a05. {{(pid=87303) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:41:33 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Creating volume glance metadata for volume 3827babc-d397-42d4-9aa0-20df38790a05 backed by image 6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '48da8f64d4ec83a27371874e103455d8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87303) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:41:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc07eae-e286-4ce2-af74-ee25d5187f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3827babc-d397-42d4-9aa0-20df38790a05', 'volume_size': 1, 'image_id': '6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '48da8f64d4ec83a27371874e103455d8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d80fa0f78ef4ede945be5ae93eded2a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2cc4ffca61c43729ce1f53757e3b111f0e2c7819c0e30746f874a2d1c6649ec7baf12ca6272053534c87c2b3609a159ff7cfb41c82f963cb7c424ce6cde13dd9', 'id': '6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b', 'created_at': datetime.datetime(2026, 7, 7, 15, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6a2648f9-a9a2-4098-9afd-09ad2a6c4e6b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d33dc7c7-b5bc-4d44-86b5-ce70ec29fb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:33 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Volume volume-3827babc-d397-42d4-9aa0-20df38790a05 (3827babc-d397-42d4-9aa0-20df38790a05): created successfully Jul 07 17:41:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d33dc7c7-b5bc-4d44-86b5-ce70ec29fb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:33 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Flow 'volume_create_manager' (52e57500-3a94-4fd4-85a0-f0ef7ffca4de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:33 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-2a62d818-db86-45b2-9233-2ad42f79b7cd tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Created volume successfully. Jul 07 17:41:34 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-71e0fad7-e6fd-4d60-bcce-5b5030ec7984" returned: 0 in 0.808s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] <== create_volume: return (2238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.241s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.707s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1119741027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81550649-3246-4325-ad82-5824838686c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bedced91c0c4676b85958d3f30d1d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:15Z,use_quota=True,user_id='a21d7d08a53449dd94e8c4bfbbf5551c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Creating volume 81550649-3246-4325-ad82-5824838686c0 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:34 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:41:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-81550649-3246-4325-ad82-5824838686c0 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9b1fbe-5f88-45a8-bedf-dc9ac7e95f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71e0fad7-e6fd-4d60-bcce-5b5030ec7984', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:34 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-81550649-3246-4325-ad82-5824838686c0 1073741824 Jul 07 17:41:34 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ffde684-d086-4f47-a987-c2331ce2c719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8ff67e66-b318-447b-90be-37e7e1ca7b19 tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Acquiring lock "cinder-3827babc-d397-42d4-9aa0-20df38790a05-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:34 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Volume volume-71e0fad7-e6fd-4d60-bcce-5b5030ec7984 (71e0fad7-e6fd-4d60-bcce-5b5030ec7984): created successfully Jul 07 17:41:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ffde684-d086-4f47-a987-c2331ce2c719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:34 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Flow 'volume_create_manager' (098aad9a-03e7-46a5-b02c-1f3d4869b8ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8ff67e66-b318-447b-90be-37e7e1ca7b19 tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Lock "cinder-3827babc-d397-42d4-9aa0-20df38790a05-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:34 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-dbca1ea1-15b2-4c94-a01f-f0e6fb36407b tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Created volume successfully. Jul 07 17:41:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8ff67e66-b318-447b-90be-37e7e1ca7b19 tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Acquiring lock "cinder-quobyte-3827babc-d397-42d4-9aa0-20df38790a05" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8ff67e66-b318-447b-90be-37e7e1ca7b19 tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Lock "cinder-quobyte-3827babc-d397-42d4-9aa0-20df38790a05" acquired by "delete_volume" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:34 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[0558f061-ef3a-48ae-8018-caeb6ab8e24c]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8ff67e66-b318-447b-90be-37e7e1ca7b19 tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:34 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05 Jul 07 17:41:34 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:35 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-81550649-3246-4325-ad82-5824838686c0 1073741824" returned: 0 in 1.049s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-81550649-3246-4325-ad82-5824838686c0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:35 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-81550649-3246-4325-ad82-5824838686c0 Jul 07 17:41:35 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:35 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8ff67e66-b318-447b-90be-37e7e1ca7b19 tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05" returned: 0 in 0.945s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8ff67e66-b318-447b-90be-37e7e1ca7b19 tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:35 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05 Jul 07 17:41:35 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:36 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-81550649-3246-4325-ad82-5824838686c0" returned: 0 in 0.769s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.618s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1289698493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26d9838-0538-46b4-935c-c29bcc7967a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f90b720b394234bf3dd532abef92e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:24Z,use_quota=True,user_id='bc83121ff3b3407c97024246f349b048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Creating volume b26d9838-0538-46b4-935c-c29bcc7967a3 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:36 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b26d9838-0538-46b4-935c-c29bcc7967a3 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff8f7823-d588-4193-bf30-f0f935a1b8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81550649-3246-4325-ad82-5824838686c0', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b900dd4-01fd-480a-80a0-fb74de673bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:36 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b26d9838-0538-46b4-935c-c29bcc7967a3 1073741824 Jul 07 17:41:36 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:36 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Volume volume-81550649-3246-4325-ad82-5824838686c0 (81550649-3246-4325-ad82-5824838686c0): created successfully Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b900dd4-01fd-480a-80a0-fb74de673bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Flow 'volume_create_manager' (6f8bdc8f-9ab1-4499-aef8-aaed4a34aad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:36 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-e94c597e-5aee-47fe-aa0a-daa053046557 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Created volume successfully. Jul 07 17:41:36 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8ff67e66-b318-447b-90be-37e7e1ca7b19 tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05" returned: 1 in 0.895s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8ff67e66-b318-447b-90be-37e7e1ca7b19 tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8ff67e66-b318-447b-90be-37e7e1ca7b19 tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:36 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05 Jul 07 17:41:36 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-08d97a76-6ce1-4505-b06f-08eb5c9eb9b1 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "cinder-81550649-3246-4325-ad82-5824838686c0-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-08d97a76-6ce1-4505-b06f-08eb5c9eb9b1 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-81550649-3246-4325-ad82-5824838686c0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-08d97a76-6ce1-4505-b06f-08eb5c9eb9b1 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "cinder-quobyte-81550649-3246-4325-ad82-5824838686c0" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-08d97a76-6ce1-4505-b06f-08eb5c9eb9b1 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-quobyte-81550649-3246-4325-ad82-5824838686c0" acquired by "delete_volume" :: waited 0.028s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5655b9-3d79-4e55-9c20-14d8df395571]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-08d97a76-6ce1-4505-b06f-08eb5c9eb9b1 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-81550649-3246-4325-ad82-5824838686c0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:36 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-81550649-3246-4325-ad82-5824838686c0 Jul 07 17:41:36 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:37 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b26d9838-0538-46b4-935c-c29bcc7967a3 1073741824" returned: 0 in 0.997s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b26d9838-0538-46b4-935c-c29bcc7967a3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:37 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8ff67e66-b318-447b-90be-37e7e1ca7b19 tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3827babc-d397-42d4-9aa0-20df38790a05" returned: 0 in 0.894s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:37 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b26d9838-0538-46b4-935c-c29bcc7967a3 Jul 07 17:41:37 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:37 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8ff67e66-b318-447b-90be-37e7e1ca7b19 tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Lock "cinder-quobyte-3827babc-d397-42d4-9aa0-20df38790a05" released by "delete_volume" :: held 2.837s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:37 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-8ff67e66-b318-447b-90be-37e7e1ca7b19 tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Created reservations ['a4c5914d-a42f-4922-a469-bb8f8d775f3c', '2c859e11-7346-42a9-a22b-503ea8ed3944', '1897becf-26b4-4c6b-93c2-f9c94542de86', 'f0620aa9-37b2-45b1-b89e-3363fd33581c'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8ff67e66-b318-447b-90be-37e7e1ca7b19 tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8ff67e66-b318-447b-90be-37e7e1ca7b19 tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-8ff67e66-b318-447b-90be-37e7e1ca7b19 tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:37 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-8ff67e66-b318-447b-90be-37e7e1ca7b19 tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-8ff67e66-b318-447b-90be-37e7e1ca7b19 tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8ff67e66-b318-447b-90be-37e7e1ca7b19 tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:37 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:41:37 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:37 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-08d97a76-6ce1-4505-b06f-08eb5c9eb9b1 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-81550649-3246-4325-ad82-5824838686c0" returned: 0 in 1.160s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-08d97a76-6ce1-4505-b06f-08eb5c9eb9b1 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-81550649-3246-4325-ad82-5824838686c0 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:38 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-81550649-3246-4325-ad82-5824838686c0 Jul 07 17:41:38 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:38 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b26d9838-0538-46b4-935c-c29bcc7967a3" returned: 0 in 1.089s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] <== create_volume: return (2175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.180s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.258s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1362742754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5026e4fa-826d-4589-854e-4446069a1c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f90b720b394234bf3dd532abef92e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:25Z,use_quota=True,user_id='bc83121ff3b3407c97024246f349b048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Creating volume 5026e4fa-826d-4589-854e-4446069a1c6f {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:38 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:41:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5026e4fa-826d-4589-854e-4446069a1c6f 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:38 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-8ff67e66-b318-447b-90be-37e7e1ca7b19 tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.938s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:38 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-8ff67e66-b318-447b-90be-37e7e1ca7b19 tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:38 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5026e4fa-826d-4589-854e-4446069a1c6f 1073741824 Jul 07 17:41:38 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (742ab0c5-9b3e-4f92-834e-53e162729f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b26d9838-0538-46b4-935c-c29bcc7967a3', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7386064f-bbe7-4bb2-b2e0-8698ae86fb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:38 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-8ff67e66-b318-447b-90be-37e7e1ca7b19 tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Deleted volume successfully. Jul 07 17:41:38 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Volume volume-b26d9838-0538-46b4-935c-c29bcc7967a3 (b26d9838-0538-46b4-935c-c29bcc7967a3): created successfully Jul 07 17:41:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7386064f-bbe7-4bb2-b2e0-8698ae86fb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Flow 'volume_create_manager' (8edebd35-d924-4887-8420-7d031d439cc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:38 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-8ff67e66-b318-447b-90be-37e7e1ca7b19 tempest-VolumeAndVolumeTypeFromImageTest-1635132863 None] Lock "cinder-3827babc-d397-42d4-9aa0-20df38790a05-delete_volume" released by "delete_volume" :: held 4.211s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:38 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-7c0f3ebd-620c-410d-a62e-b616844a5c27 tempest-CreateVolumesFromSnapshotTest-116157209 None] Created volume successfully. Jul 07 17:41:39 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-08d97a76-6ce1-4505-b06f-08eb5c9eb9b1 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-81550649-3246-4325-ad82-5824838686c0" returned: 0 in 1.051s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:39 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-08d97a76-6ce1-4505-b06f-08eb5c9eb9b1 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-quobyte-81550649-3246-4325-ad82-5824838686c0" released by "delete_volume" :: held 2.278s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:39 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-08d97a76-6ce1-4505-b06f-08eb5c9eb9b1 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Created reservations ['2a3b3582-9495-4f07-b81e-ab4f34f15261', '961f5502-5f16-4156-a5d6-0593dcebc708', 'af021ee4-8d70-46d3-9145-2e0588083737', '6a7d7108-5c19-4345-a005-4a30a81c9058'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-08d97a76-6ce1-4505-b06f-08eb5c9eb9b1 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-08d97a76-6ce1-4505-b06f-08eb5c9eb9b1 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:39 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-08d97a76-6ce1-4505-b06f-08eb5c9eb9b1 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:39 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-08d97a76-6ce1-4505-b06f-08eb5c9eb9b1 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-08d97a76-6ce1-4505-b06f-08eb5c9eb9b1 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-08d97a76-6ce1-4505-b06f-08eb5c9eb9b1 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:39 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:41:39 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:39 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5026e4fa-826d-4589-854e-4446069a1c6f 1073741824" returned: 0 in 1.198s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5026e4fa-826d-4589-854e-4446069a1c6f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:39 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5026e4fa-826d-4589-854e-4446069a1c6f Jul 07 17:41:39 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cbb70b47-be56-40ff-80e5-c0bce2c0feea tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "cinder-71e0fad7-e6fd-4d60-bcce-5b5030ec7984-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cbb70b47-be56-40ff-80e5-c0bce2c0feea tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-71e0fad7-e6fd-4d60-bcce-5b5030ec7984-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:40 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-08d97a76-6ce1-4505-b06f-08eb5c9eb9b1 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.083s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-08d97a76-6ce1-4505-b06f-08eb5c9eb9b1 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:40 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-08d97a76-6ce1-4505-b06f-08eb5c9eb9b1 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Deleted volume successfully. Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cbb70b47-be56-40ff-80e5-c0bce2c0feea tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "cinder-quobyte-71e0fad7-e6fd-4d60-bcce-5b5030ec7984" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-08d97a76-6ce1-4505-b06f-08eb5c9eb9b1 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-81550649-3246-4325-ad82-5824838686c0-delete_volume" released by "delete_volume" :: held 3.673s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cbb70b47-be56-40ff-80e5-c0bce2c0feea tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-quobyte-71e0fad7-e6fd-4d60-bcce-5b5030ec7984" acquired by "delete_volume" :: waited 0.027s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[a397b0f2-b8a0-43fe-9f53-f328482fef95]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cbb70b47-be56-40ff-80e5-c0bce2c0feea tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-71e0fad7-e6fd-4d60-bcce-5b5030ec7984 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:40 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-71e0fad7-e6fd-4d60-bcce-5b5030ec7984 Jul 07 17:41:40 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:40 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5026e4fa-826d-4589-854e-4446069a1c6f" returned: 0 in 1.151s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] <== create_volume: return (2458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.464s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.318s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1640362358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f90b720b394234bf3dd532abef92e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:25Z,use_quota=True,user_id='bc83121ff3b3407c97024246f349b048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Creating volume c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:40 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc01a851-60f7-48e4-9dfd-9a13d9f79164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5026e4fa-826d-4589-854e-4446069a1c6f', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0bb3863-369b-4975-b790-f278ad4996ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:40 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8 1073741824 Jul 07 17:41:40 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:40 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Volume volume-5026e4fa-826d-4589-854e-4446069a1c6f (5026e4fa-826d-4589-854e-4446069a1c6f): created successfully Jul 07 17:41:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0bb3863-369b-4975-b790-f278ad4996ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Flow 'volume_create_manager' (0eaa4e6c-2064-49c4-9d70-3bedd577bd00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:41 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-3ff44755-e7e1-414a-ba6d-d2dc45c66da7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Created volume successfully. Jul 07 17:41:41 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cbb70b47-be56-40ff-80e5-c0bce2c0feea tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-71e0fad7-e6fd-4d60-bcce-5b5030ec7984" returned: 0 in 1.176s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cbb70b47-be56-40ff-80e5-c0bce2c0feea tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-71e0fad7-e6fd-4d60-bcce-5b5030ec7984 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:41 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-71e0fad7-e6fd-4d60-bcce-5b5030ec7984 Jul 07 17:41:41 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:42 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8 1073741824" returned: 0 in 1.329s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:42 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8 Jul 07 17:41:42 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:42 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cbb70b47-be56-40ff-80e5-c0bce2c0feea tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-71e0fad7-e6fd-4d60-bcce-5b5030ec7984" returned: 0 in 0.853s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:42 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cbb70b47-be56-40ff-80e5-c0bce2c0feea tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-quobyte-71e0fad7-e6fd-4d60-bcce-5b5030ec7984" released by "delete_volume" :: held 2.089s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:42 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-cbb70b47-be56-40ff-80e5-c0bce2c0feea tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Created reservations ['af91a12f-e997-40b7-86e3-a1526ecc8893', '94dd02ec-5c8f-47bb-b435-326e3399ec7b', '70310621-8c10-41bc-b4ef-56946784bf35', '453e1572-9bab-4080-89ce-8f025888fba2'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-cbb70b47-be56-40ff-80e5-c0bce2c0feea tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-cbb70b47-be56-40ff-80e5-c0bce2c0feea tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-cbb70b47-be56-40ff-80e5-c0bce2c0feea tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-cbb70b47-be56-40ff-80e5-c0bce2c0feea tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-cbb70b47-be56-40ff-80e5-c0bce2c0feea tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cbb70b47-be56-40ff-80e5-c0bce2c0feea tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:42 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:41:42 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:43 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8" returned: 0 in 0.794s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] <== create_volume: return (2195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.200s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.896s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1706928049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4614c83-f783-4eba-9908-fc532883d133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f90b720b394234bf3dd532abef92e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:26Z,use_quota=True,user_id='bc83121ff3b3407c97024246f349b048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Creating volume f4614c83-f783-4eba-9908-fc532883d133 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:43 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f4614c83-f783-4eba-9908-fc532883d133 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b71c3d5-644a-4941-b512-8abc7d29aac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:43 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f4614c83-f783-4eba-9908-fc532883d133 1073741824 Jul 07 17:41:43 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b4fad1-1093-4bbe-b768-021d082d26d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:43 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Volume volume-c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8 (c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8): created successfully Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b4fad1-1093-4bbe-b768-021d082d26d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Flow 'volume_create_manager' (11773370-048e-4c69-b655-b055109331d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:43 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-46bc3e41-9831-4a01-8e34-cad002e4cecd tempest-CreateVolumesFromSnapshotTest-116157209 None] Created volume successfully. Jul 07 17:41:43 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cbb70b47-be56-40ff-80e5-c0bce2c0feea tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.898s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-cbb70b47-be56-40ff-80e5-c0bce2c0feea tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:43 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-cbb70b47-be56-40ff-80e5-c0bce2c0feea tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Deleted volume successfully. Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cbb70b47-be56-40ff-80e5-c0bce2c0feea tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-71e0fad7-e6fd-4d60-bcce-5b5030ec7984-delete_volume" released by "delete_volume" :: held 3.403s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bcc76370-2bf1-42a4-8662-9a3beca67d7f tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "cinder-bfaf5adc-dda6-47be-962d-ad606ea46c54-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bcc76370-2bf1-42a4-8662-9a3beca67d7f tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-bfaf5adc-dda6-47be-962d-ad606ea46c54-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bcc76370-2bf1-42a4-8662-9a3beca67d7f tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "cinder-quobyte-bfaf5adc-dda6-47be-962d-ad606ea46c54" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bcc76370-2bf1-42a4-8662-9a3beca67d7f tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-quobyte-bfaf5adc-dda6-47be-962d-ad606ea46c54" acquired by "delete_volume" :: waited 0.023s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f1aa6a-24d4-4c35-8f2e-48c0e9058635]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bcc76370-2bf1-42a4-8662-9a3beca67d7f tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bfaf5adc-dda6-47be-962d-ad606ea46c54 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:44 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bfaf5adc-dda6-47be-962d-ad606ea46c54 Jul 07 17:41:44 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:44 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:41:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Flow 'volume_create_manager' (31a999f2-d46e-4f92-aecd-27833e7d607f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0226e39-2320-4f52-9209-709afeeb2a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:44 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0226e39-2320-4f52-9209-709afeeb2a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-284057837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e1d8d5-5440-45be-b171-06ce29f36705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ac77c0e4184ec79759fdc2759452f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:44Z,use_quota=True,user_id='432b342bf7cf42968fe570ca1f4ae255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d23d84-17ae-41a1-9224-15005ec949c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d23d84-17ae-41a1-9224-15005ec949c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb858d1e-aef2-4f12-965a-374b1cf07765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb858d1e-aef2-4f12-965a-374b1cf07765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1e1d8d5-5440-45be-b171-06ce29f36705', 'volume_name': 'volume-d1e1d8d5-5440-45be-b171-06ce29f36705', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82f4f9a-e9c1-4e8b-bcdd-795612931655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82f4f9a-e9c1-4e8b-bcdd-795612931655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e269cdbb-9217-47be-8542-f66ce6e80fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:44 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Volume d1e1d8d5-5440-45be-b171-06ce29f36705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1e1d8d5-5440-45be-b171-06ce29f36705', 'volume_size': 1} Jul 07 17:41:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f4614c83-f783-4eba-9908-fc532883d133 1073741824" returned: 0 in 1.533s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f4614c83-f783-4eba-9908-fc532883d133 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:44 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f4614c83-f783-4eba-9908-fc532883d133 Jul 07 17:41:44 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:44 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bcc76370-2bf1-42a4-8662-9a3beca67d7f tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bfaf5adc-dda6-47be-962d-ad606ea46c54" returned: 0 in 1.125s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bcc76370-2bf1-42a4-8662-9a3beca67d7f tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bfaf5adc-dda6-47be-962d-ad606ea46c54 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:45 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bfaf5adc-dda6-47be-962d-ad606ea46c54 Jul 07 17:41:45 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:45 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f4614c83-f783-4eba-9908-fc532883d133" returned: 0 in 0.759s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] <== create_volume: return (2344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.349s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.662s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-531008494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3605d0bd-91c8-4eaa-86b2-a199249b292d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f90b720b394234bf3dd532abef92e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:27Z,use_quota=True,user_id='bc83121ff3b3407c97024246f349b048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Creating volume 3605d0bd-91c8-4eaa-86b2-a199249b292d {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:45 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3605d0bd-91c8-4eaa-86b2-a199249b292d 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b452787-938e-4437-b249-71a663bb79a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4614c83-f783-4eba-9908-fc532883d133', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c13e866-72b2-4240-b4e6-e3e98f73c68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:45 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3605d0bd-91c8-4eaa-86b2-a199249b292d 1073741824 Jul 07 17:41:45 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:45 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Volume volume-f4614c83-f783-4eba-9908-fc532883d133 (f4614c83-f783-4eba-9908-fc532883d133): created successfully Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c13e866-72b2-4240-b4e6-e3e98f73c68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Flow 'volume_create_manager' (ba87ea28-852f-40b3-9206-9ff99fb05dc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:45 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b6544d57-a0f6-41f1-b8d7-11efc82416d5 tempest-CreateVolumesFromSnapshotTest-116157209 None] Created volume successfully. Jul 07 17:41:45 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bcc76370-2bf1-42a4-8662-9a3beca67d7f tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-bfaf5adc-dda6-47be-962d-ad606ea46c54" returned: 0 in 0.770s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bcc76370-2bf1-42a4-8662-9a3beca67d7f tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-quobyte-bfaf5adc-dda6-47be-962d-ad606ea46c54" released by "delete_volume" :: held 1.962s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-bcc76370-2bf1-42a4-8662-9a3beca67d7f tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Created reservations ['2a0731ae-262a-438e-9ccc-ade75edbd3d3', 'ef74f025-7edd-480e-87b9-8f5cf4a30d6d', '5f148a40-69cd-42b3-ac76-ce749b1619a3', '814392d2-9195-4d86-9abc-1fd138cd53b1'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bcc76370-2bf1-42a4-8662-9a3beca67d7f tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bcc76370-2bf1-42a4-8662-9a3beca67d7f tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-bcc76370-2bf1-42a4-8662-9a3beca67d7f tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-bcc76370-2bf1-42a4-8662-9a3beca67d7f tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bcc76370-2bf1-42a4-8662-9a3beca67d7f tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bcc76370-2bf1-42a4-8662-9a3beca67d7f tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:45 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:41:45 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:45 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7daad479-68b4-402b-8d76-8b39dd155ffb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "cinder-9a430f46-c856-4021-8779-5e554ba099d5-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:46 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7daad479-68b4-402b-8d76-8b39dd155ffb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-9a430f46-c856-4021-8779-5e554ba099d5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:46 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7daad479-68b4-402b-8d76-8b39dd155ffb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "cinder-quobyte-9a430f46-c856-4021-8779-5e554ba099d5" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:46 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7daad479-68b4-402b-8d76-8b39dd155ffb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-quobyte-9a430f46-c856-4021-8779-5e554ba099d5" acquired by "delete_volume" :: waited 0.024s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:46 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[1124e6ca-ffcb-4c74-9b04-10c81b557695]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7daad479-68b4-402b-8d76-8b39dd155ffb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9a430f46-c856-4021-8779-5e554ba099d5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:46 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9a430f46-c856-4021-8779-5e554ba099d5 Jul 07 17:41:46 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:46 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3605d0bd-91c8-4eaa-86b2-a199249b292d 1073741824" returned: 0 in 1.186s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3605d0bd-91c8-4eaa-86b2-a199249b292d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:46 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3605d0bd-91c8-4eaa-86b2-a199249b292d Jul 07 17:41:46 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:46 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bcc76370-2bf1-42a4-8662-9a3beca67d7f tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.927s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:46 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-bcc76370-2bf1-42a4-8662-9a3beca67d7f tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:46 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-bcc76370-2bf1-42a4-8662-9a3beca67d7f tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Deleted volume successfully. Jul 07 17:41:46 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bcc76370-2bf1-42a4-8662-9a3beca67d7f tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-bfaf5adc-dda6-47be-962d-ad606ea46c54-delete_volume" released by "delete_volume" :: held 3.190s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:47 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7daad479-68b4-402b-8d76-8b39dd155ffb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9a430f46-c856-4021-8779-5e554ba099d5" returned: 0 in 1.002s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7daad479-68b4-402b-8d76-8b39dd155ffb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9a430f46-c856-4021-8779-5e554ba099d5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:47 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9a430f46-c856-4021-8779-5e554ba099d5 Jul 07 17:41:47 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:47 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3605d0bd-91c8-4eaa-86b2-a199249b292d" returned: 0 in 0.815s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] <== create_volume: return (2066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.884s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-284057837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e1d8d5-5440-45be-b171-06ce29f36705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ac77c0e4184ec79759fdc2759452f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:41:44Z,use_quota=True,user_id='432b342bf7cf42968fe570ca1f4ae255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:41:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Creating volume d1e1d8d5-5440-45be-b171-06ce29f36705 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:41:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:41:47 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:41:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:47 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705 1073741824 Jul 07 17:41:47 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c797d43-4100-4d98-a85e-202e435aa372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3605d0bd-91c8-4eaa-86b2-a199249b292d', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0370efd4-62b4-4507-8108-1a5423918709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:47 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Volume volume-3605d0bd-91c8-4eaa-86b2-a199249b292d (3605d0bd-91c8-4eaa-86b2-a199249b292d): created successfully Jul 07 17:41:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0370efd4-62b4-4507-8108-1a5423918709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Flow 'volume_create_manager' (4d76ca7e-8654-4888-9f03-567226224109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:47 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-141896c4-1252-4569-8639-87a66176b25f tempest-CreateVolumesFromSnapshotTest-116157209 None] Created volume successfully. Jul 07 17:41:48 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7091932d-d2e3-406f-a198-b92ae27879d7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "cinder-3605d0bd-91c8-4eaa-86b2-a199249b292d-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7daad479-68b4-402b-8d76-8b39dd155ffb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-9a430f46-c856-4021-8779-5e554ba099d5" returned: 0 in 0.897s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7daad479-68b4-402b-8d76-8b39dd155ffb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-quobyte-9a430f46-c856-4021-8779-5e554ba099d5" released by "delete_volume" :: held 1.985s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7091932d-d2e3-406f-a198-b92ae27879d7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-3605d0bd-91c8-4eaa-86b2-a199249b292d-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7091932d-d2e3-406f-a198-b92ae27879d7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "cinder-quobyte-3605d0bd-91c8-4eaa-86b2-a199249b292d" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:48 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-7daad479-68b4-402b-8d76-8b39dd155ffb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Created reservations ['14af154c-1d6b-4105-b4a7-02599e3a9377', '27d9106e-d7b2-40db-bea7-919dc14de085', 'cc89b153-b143-478a-9e18-9f782f9363f9', '750bacc9-b134-430d-9097-c114112b50b8'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7091932d-d2e3-406f-a198-b92ae27879d7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-quobyte-3605d0bd-91c8-4eaa-86b2-a199249b292d" acquired by "delete_volume" :: waited 0.049s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:48 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3dbaed-8563-42a0-bb54-d78ed6265a4b]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7091932d-d2e3-406f-a198-b92ae27879d7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3605d0bd-91c8-4eaa-86b2-a199249b292d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7daad479-68b4-402b-8d76-8b39dd155ffb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7daad479-68b4-402b-8d76-8b39dd155ffb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7daad479-68b4-402b-8d76-8b39dd155ffb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7daad479-68b4-402b-8d76-8b39dd155ffb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7daad479-68b4-402b-8d76-8b39dd155ffb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7daad479-68b4-402b-8d76-8b39dd155ffb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:48 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:41:48 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:48 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3605d0bd-91c8-4eaa-86b2-a199249b292d Jul 07 17:41:48 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:48 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705 1073741824" returned: 0 in 1.187s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:48 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705 Jul 07 17:41:48 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:49 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7091932d-d2e3-406f-a198-b92ae27879d7 tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3605d0bd-91c8-4eaa-86b2-a199249b292d" returned: 0 in 0.976s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7091932d-d2e3-406f-a198-b92ae27879d7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3605d0bd-91c8-4eaa-86b2-a199249b292d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:49 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3605d0bd-91c8-4eaa-86b2-a199249b292d Jul 07 17:41:49 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:49 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7daad479-68b4-402b-8d76-8b39dd155ffb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.940s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:49 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-7daad479-68b4-402b-8d76-8b39dd155ffb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:49 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-7daad479-68b4-402b-8d76-8b39dd155ffb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Deleted volume successfully. Jul 07 17:41:49 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7daad479-68b4-402b-8d76-8b39dd155ffb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-9a430f46-c856-4021-8779-5e554ba099d5-delete_volume" released by "delete_volume" :: held 3.369s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:49 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1d91512d-c0a9-4f26-a9f7-418df4a793fb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "cinder-e4e87768-66e2-4e1d-b53a-505ec5d3d081-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:49 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1d91512d-c0a9-4f26-a9f7-418df4a793fb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-e4e87768-66e2-4e1d-b53a-505ec5d3d081-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:49 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1d91512d-c0a9-4f26-a9f7-418df4a793fb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "cinder-quobyte-e4e87768-66e2-4e1d-b53a-505ec5d3d081" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:49 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1d91512d-c0a9-4f26-a9f7-418df4a793fb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-quobyte-e4e87768-66e2-4e1d-b53a-505ec5d3d081" acquired by "delete_volume" :: waited 0.020s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:49 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8b85d7-c3bd-43ad-a792-76b82fee148e]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1d91512d-c0a9-4f26-a9f7-418df4a793fb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e4e87768-66e2-4e1d-b53a-505ec5d3d081 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:49 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705" returned: 0 in 0.933s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] <== create_volume: return (2228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:41:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.232s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e269cdbb-9217-47be-8542-f66ce6e80fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1e1d8d5-5440-45be-b171-06ce29f36705', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (424265bf-3707-434d-bffd-796bb0ea1809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:41:49 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e4e87768-66e2-4e1d-b53a-505ec5d3d081 Jul 07 17:41:49 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:49 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Volume volume-d1e1d8d5-5440-45be-b171-06ce29f36705 (d1e1d8d5-5440-45be-b171-06ce29f36705): created successfully Jul 07 17:41:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (424265bf-3707-434d-bffd-796bb0ea1809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:41:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Flow 'volume_create_manager' (31a999f2-d46e-4f92-aecd-27833e7d607f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:41:49 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-13f7f447-ac8b-460c-b9a1-d4b717c83349 tempest-ProjectReaderTests-1690191251 None] Created volume successfully. Jul 07 17:41:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-30f722b4-6c43-43e9-bfad-f2e98456617a tempest-ProjectReaderTests-1690191251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-30f722b4-6c43-43e9-bfad-f2e98456617a tempest-ProjectReaderTests-1690191251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:50 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7091932d-d2e3-406f-a198-b92ae27879d7 tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-3605d0bd-91c8-4eaa-86b2-a199249b292d" returned: 0 in 1.054s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-30f722b4-6c43-43e9-bfad-f2e98456617a tempest-ProjectReaderTests-1690191251 None] Creating offline snapshot bfe58f77-cb61-486d-973d-d3f0e121d5fc of volume d1e1d8d5-5440-45be-b171-06ce29f36705 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:41:50 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7091932d-d2e3-406f-a198-b92ae27879d7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-quobyte-3605d0bd-91c8-4eaa-86b2-a199249b292d" released by "delete_volume" :: held 2.128s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:50 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41a5790-e9ab-4412-9f87-c3de61da1ec0]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-30f722b4-6c43-43e9-bfad-f2e98456617a tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:50 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-7091932d-d2e3-406f-a198-b92ae27879d7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Created reservations ['cc10b1ef-353e-42ec-9239-1240de68c359', 'c133f5d2-718b-46c2-a11a-6b5521a458c4', '3b41c014-8f22-4447-b50a-f0e22115480f', '642d4f30-7216-49cd-b2c3-69d53d5d7b64'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:50 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705 Jul 07 17:41:50 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7091932d-d2e3-406f-a198-b92ae27879d7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7091932d-d2e3-406f-a198-b92ae27879d7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7091932d-d2e3-406f-a198-b92ae27879d7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7091932d-d2e3-406f-a198-b92ae27879d7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7091932d-d2e3-406f-a198-b92ae27879d7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7091932d-d2e3-406f-a198-b92ae27879d7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:50 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:41:50 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:50 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1d91512d-c0a9-4f26-a9f7-418df4a793fb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e4e87768-66e2-4e1d-b53a-505ec5d3d081" returned: 0 in 1.110s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1d91512d-c0a9-4f26-a9f7-418df4a793fb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e4e87768-66e2-4e1d-b53a-505ec5d3d081 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:50 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e4e87768-66e2-4e1d-b53a-505ec5d3d081 Jul 07 17:41:50 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:51 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7091932d-d2e3-406f-a198-b92ae27879d7 tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.842s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:51 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-7091932d-d2e3-406f-a198-b92ae27879d7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:51 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-7091932d-d2e3-406f-a198-b92ae27879d7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Deleted volume successfully. Jul 07 17:41:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7091932d-d2e3-406f-a198-b92ae27879d7 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-3605d0bd-91c8-4eaa-86b2-a199249b292d-delete_volume" released by "delete_volume" :: held 3.374s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:51 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-07111391-79b7-4b2c-9c71-331efe86e972 tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "cinder-f4614c83-f783-4eba-9908-fc532883d133-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-30f722b4-6c43-43e9-bfad-f2e98456617a tempest-ProjectReaderTests-1690191251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705" returned: 0 in 1.172s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-30f722b4-6c43-43e9-bfad-f2e98456617a tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.bfe58f77-cb61-486d-973d-d3f0e121d5fc 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-07111391-79b7-4b2c-9c71-331efe86e972 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-f4614c83-f783-4eba-9908-fc532883d133-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:51 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.bfe58f77-cb61-486d-973d-d3f0e121d5fc 1G Jul 07 17:41:51 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-07111391-79b7-4b2c-9c71-331efe86e972 tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "cinder-quobyte-f4614c83-f783-4eba-9908-fc532883d133" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-07111391-79b7-4b2c-9c71-331efe86e972 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-quobyte-f4614c83-f783-4eba-9908-fc532883d133" acquired by "delete_volume" :: waited 0.020s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:51 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0746c9-97b7-47ec-be54-8d41fb236cb6]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-07111391-79b7-4b2c-9c71-331efe86e972 tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f4614c83-f783-4eba-9908-fc532883d133 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:51 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1d91512d-c0a9-4f26-a9f7-418df4a793fb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e4e87768-66e2-4e1d-b53a-505ec5d3d081" returned: 0 in 1.002s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1d91512d-c0a9-4f26-a9f7-418df4a793fb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-quobyte-e4e87768-66e2-4e1d-b53a-505ec5d3d081" released by "delete_volume" :: held 2.173s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:51 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f4614c83-f783-4eba-9908-fc532883d133 Jul 07 17:41:51 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:51 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-1d91512d-c0a9-4f26-a9f7-418df4a793fb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Created reservations ['ef143fed-ca6c-4c9f-8e37-4dc4881128dd', 'a9ce55f3-c32f-4cf0-85e7-0c713ccf48af', 'd5050b89-4c0a-437f-a71f-83295fc64c90', '18c6dd61-2875-41f5-bebb-8562ba5a2dc6'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1d91512d-c0a9-4f26-a9f7-418df4a793fb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1d91512d-c0a9-4f26-a9f7-418df4a793fb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1d91512d-c0a9-4f26-a9f7-418df4a793fb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1d91512d-c0a9-4f26-a9f7-418df4a793fb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1d91512d-c0a9-4f26-a9f7-418df4a793fb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1d91512d-c0a9-4f26-a9f7-418df4a793fb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:51 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:41:51 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:52 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-30f722b4-6c43-43e9-bfad-f2e98456617a tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.bfe58f77-cb61-486d-973d-d3f0e121d5fc 1G" returned: 0 in 1.037s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-30f722b4-6c43-43e9-bfad-f2e98456617a tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1e1d8d5-5440-45be-b171-06ce29f36705 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.bfe58f77-cb61-486d-973d-d3f0e121d5fc {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:52 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1e1d8d5-5440-45be-b171-06ce29f36705 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.bfe58f77-cb61-486d-973d-d3f0e121d5fc Jul 07 17:41:52 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:52 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1d91512d-c0a9-4f26-a9f7-418df4a793fb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.829s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:52 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:52 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-1d91512d-c0a9-4f26-a9f7-418df4a793fb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-07111391-79b7-4b2c-9c71-331efe86e972 tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f4614c83-f783-4eba-9908-fc532883d133" returned: 0 in 1.068s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-07111391-79b7-4b2c-9c71-331efe86e972 tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f4614c83-f783-4eba-9908-fc532883d133 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:52 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-1d91512d-c0a9-4f26-a9f7-418df4a793fb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Deleted volume successfully. Jul 07 17:41:52 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f4614c83-f783-4eba-9908-fc532883d133 Jul 07 17:41:52 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:52 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1d91512d-c0a9-4f26-a9f7-418df4a793fb tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-e4e87768-66e2-4e1d-b53a-505ec5d3d081-delete_volume" released by "delete_volume" :: held 3.307s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:52 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5aac5fa7-42ea-4eaa-91cb-43910bca4757 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "cinder-e94ecac6-cb63-4a3e-aa8a-39057caabafe-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:52 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5aac5fa7-42ea-4eaa-91cb-43910bca4757 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-e94ecac6-cb63-4a3e-aa8a-39057caabafe-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5aac5fa7-42ea-4eaa-91cb-43910bca4757 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "cinder-quobyte-e94ecac6-cb63-4a3e-aa8a-39057caabafe" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5aac5fa7-42ea-4eaa-91cb-43910bca4757 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-quobyte-e94ecac6-cb63-4a3e-aa8a-39057caabafe" acquired by "delete_volume" :: waited 0.024s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:53 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[9621a418-d2be-427d-89c1-33fe144c4001]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5aac5fa7-42ea-4eaa-91cb-43910bca4757 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e94ecac6-cb63-4a3e-aa8a-39057caabafe {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:53 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e94ecac6-cb63-4a3e-aa8a-39057caabafe Jul 07 17:41:53 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:53 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-30f722b4-6c43-43e9-bfad-f2e98456617a tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1e1d8d5-5440-45be-b171-06ce29f36705 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.bfe58f77-cb61-486d-973d-d3f0e121d5fc" returned: 0 in 1.088s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:53 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-30f722b4-6c43-43e9-bfad-f2e98456617a tempest-ProjectReaderTests-1690191251 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.bfe58f77-cb61-486d-973d-d3f0e121d5fc is being set with open permissions: ugo+rw Jul 07 17:41:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-30f722b4-6c43-43e9-bfad-f2e98456617a tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.bfe58f77-cb61-486d-973d-d3f0e121d5fc {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:53 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.bfe58f77-cb61-486d-973d-d3f0e121d5fc Jul 07 17:41:53 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:53 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-07111391-79b7-4b2c-9c71-331efe86e972 tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-f4614c83-f783-4eba-9908-fc532883d133" returned: 0 in 1.057s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-07111391-79b7-4b2c-9c71-331efe86e972 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-quobyte-f4614c83-f783-4eba-9908-fc532883d133" released by "delete_volume" :: held 2.183s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:53 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-07111391-79b7-4b2c-9c71-331efe86e972 tempest-CreateVolumesFromSnapshotTest-116157209 None] Created reservations ['0f186c39-0092-4a0c-bddf-ab6609fe6b7c', '274b1f7a-3910-4dc4-a76c-954508c03b08', '0330f020-88a5-4c84-be16-f050848ee493', '125495a6-1730-4134-8267-755ffe312e74'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-07111391-79b7-4b2c-9c71-331efe86e972 tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-07111391-79b7-4b2c-9c71-331efe86e972 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:53 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-07111391-79b7-4b2c-9c71-331efe86e972 tempest-CreateVolumesFromSnapshotTest-116157209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:53 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-07111391-79b7-4b2c-9c71-331efe86e972 tempest-CreateVolumesFromSnapshotTest-116157209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-07111391-79b7-4b2c-9c71-331efe86e972 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-07111391-79b7-4b2c-9c71-331efe86e972 tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:53 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:41:53 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:54 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5aac5fa7-42ea-4eaa-91cb-43910bca4757 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e94ecac6-cb63-4a3e-aa8a-39057caabafe" returned: 0 in 1.072s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5aac5fa7-42ea-4eaa-91cb-43910bca4757 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e94ecac6-cb63-4a3e-aa8a-39057caabafe {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:54 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e94ecac6-cb63-4a3e-aa8a-39057caabafe Jul 07 17:41:54 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:54 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-30f722b4-6c43-43e9-bfad-f2e98456617a tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.bfe58f77-cb61-486d-973d-d3f0e121d5fc" returned: 0 in 0.819s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-30f722b4-6c43-43e9-bfad-f2e98456617a tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:54 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.info Jul 07 17:41:54 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:54 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-07111391-79b7-4b2c-9c71-331efe86e972 tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.832s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:54 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-07111391-79b7-4b2c-9c71-331efe86e972 tempest-CreateVolumesFromSnapshotTest-116157209 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:54 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-07111391-79b7-4b2c-9c71-331efe86e972 tempest-CreateVolumesFromSnapshotTest-116157209 None] Deleted volume successfully. Jul 07 17:41:54 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-07111391-79b7-4b2c-9c71-331efe86e972 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-f4614c83-f783-4eba-9908-fc532883d133-delete_volume" released by "delete_volume" :: held 3.283s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:55 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2693969a-77dd-43c8-8e3e-d7d329a1a90e tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "cinder-c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:55 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2693969a-77dd-43c8-8e3e-d7d329a1a90e tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:55 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2693969a-77dd-43c8-8e3e-d7d329a1a90e tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "cinder-quobyte-c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:55 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5aac5fa7-42ea-4eaa-91cb-43910bca4757 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e94ecac6-cb63-4a3e-aa8a-39057caabafe" returned: 0 in 1.022s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:55 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2693969a-77dd-43c8-8e3e-d7d329a1a90e tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-quobyte-c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8" acquired by "delete_volume" :: waited 0.037s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:55 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5aac5fa7-42ea-4eaa-91cb-43910bca4757 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-quobyte-e94ecac6-cb63-4a3e-aa8a-39057caabafe" released by "delete_volume" :: held 2.185s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:55 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9311c7-d401-45f1-8b5f-e899ddf8a1fa]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2693969a-77dd-43c8-8e3e-d7d329a1a90e tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:55 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-5aac5fa7-42ea-4eaa-91cb-43910bca4757 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Created reservations ['762953b9-9bbd-49f2-bb4d-31a1e229f72e', 'c16a06ea-febe-4568-8cc5-f5f80b928803', '89b57708-921b-433a-bbca-aa67eae345da', '7d56a99e-7dbc-4f3d-81e2-ca2a4d887834'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:55 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8 Jul 07 17:41:55 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5aac5fa7-42ea-4eaa-91cb-43910bca4757 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5aac5fa7-42ea-4eaa-91cb-43910bca4757 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:55 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5aac5fa7-42ea-4eaa-91cb-43910bca4757 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:55 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5aac5fa7-42ea-4eaa-91cb-43910bca4757 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5aac5fa7-42ea-4eaa-91cb-43910bca4757 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5aac5fa7-42ea-4eaa-91cb-43910bca4757 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:55 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:41:55 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:55 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-30f722b4-6c43-43e9-bfad-f2e98456617a tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.info" returned: 0 in 1.061s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:55 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-30f722b4-6c43-43e9-bfad-f2e98456617a tempest-ProjectReaderTests-1690191251 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.info is being set with open permissions: ugo+rw Jul 07 17:41:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-30f722b4-6c43-43e9-bfad-f2e98456617a tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:55 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.info Jul 07 17:41:55 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:56 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2693969a-77dd-43c8-8e3e-d7d329a1a90e tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8" returned: 0 in 1.037s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2693969a-77dd-43c8-8e3e-d7d329a1a90e tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:56 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8 Jul 07 17:41:56 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:56 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5aac5fa7-42ea-4eaa-91cb-43910bca4757 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.919s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:56 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-5aac5fa7-42ea-4eaa-91cb-43910bca4757 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:56 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5aac5fa7-42ea-4eaa-91cb-43910bca4757 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Deleted volume successfully. Jul 07 17:41:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5aac5fa7-42ea-4eaa-91cb-43910bca4757 tempest-CreateVolumesFromSourceVolumeTest-223690845 None] Lock "cinder-e94ecac6-cb63-4a3e-aa8a-39057caabafe-delete_volume" released by "delete_volume" :: held 3.441s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:56 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-30f722b4-6c43-43e9-bfad-f2e98456617a tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.info" returned: 0 in 0.844s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-30f722b4-6c43-43e9-bfad-f2e98456617a tempest-ProjectReaderTests-1690191251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.173s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:56 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-30f722b4-6c43-43e9-bfad-f2e98456617a tempest-ProjectReaderTests-1690191251 None] Create snapshot completed successfully Jul 07 17:41:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:41:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:56 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:41:56 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-886e6973-c587-4814-a7c6-69526cd193c4 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-bfe58f77-cb61-486d-973d-d3f0e121d5fc-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-886e6973-c587-4814-a7c6-69526cd193c4 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-bfe58f77-cb61-486d-973d-d3f0e121d5fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-886e6973-c587-4814-a7c6-69526cd193c4 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-quobyte-d1e1d8d5-5440-45be-b171-06ce29f36705" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-886e6973-c587-4814-a7c6-69526cd193c4 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-d1e1d8d5-5440-45be-b171-06ce29f36705" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-886e6973-c587-4814-a7c6-69526cd193c4 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-quobyte-bfe58f77-cb61-486d-973d-d3f0e121d5fc" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-886e6973-c587-4814-a7c6-69526cd193c4 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-bfe58f77-cb61-486d-973d-d3f0e121d5fc" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-886e6973-c587-4814-a7c6-69526cd193c4 tempest-ProjectReaderTests-1690191251 None] Deleting offline snapshot bfe58f77-cb61-486d-973d-d3f0e121d5fc of volume d1e1d8d5-5440-45be-b171-06ce29f36705 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-886e6973-c587-4814-a7c6-69526cd193c4 tempest-ProjectReaderTests-1690191251 None] snapshot_file for this snap is: volume-d1e1d8d5-5440-45be-b171-06ce29f36705.bfe58f77-cb61-486d-973d-d3f0e121d5fc {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:41:57 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2693969a-77dd-43c8-8e3e-d7d329a1a90e tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8" returned: 0 in 0.969s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[5219e5c3-bf4b-457b-b3c9-c57376edb284]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-886e6973-c587-4814-a7c6-69526cd193c4 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.bfe58f77-cb61-486d-973d-d3f0e121d5fc {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2693969a-77dd-43c8-8e3e-d7d329a1a90e tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-quobyte-c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8" released by "delete_volume" :: held 2.102s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-2693969a-77dd-43c8-8e3e-d7d329a1a90e tempest-CreateVolumesFromSnapshotTest-116157209 None] Created reservations ['eea99bb2-c953-4c33-ab15-2ef83284387b', '2d0ed15f-dca2-4203-af51-de464123c9e8', 'edb4a64c-4bfa-4d0b-888d-038a150bceec', '156d0e3c-9db0-4560-aa93-0e678dc71c18'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:41:57 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.bfe58f77-cb61-486d-973d-d3f0e121d5fc Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-2693969a-77dd-43c8-8e3e-d7d329a1a90e tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-2693969a-77dd-43c8-8e3e-d7d329a1a90e tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-2693969a-77dd-43c8-8e3e-d7d329a1a90e tempest-CreateVolumesFromSnapshotTest-116157209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-2693969a-77dd-43c8-8e3e-d7d329a1a90e tempest-CreateVolumesFromSnapshotTest-116157209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-2693969a-77dd-43c8-8e3e-d7d329a1a90e tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:41:57 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2693969a-77dd-43c8-8e3e-d7d329a1a90e tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:57 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.016s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:57 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:41:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:41:57 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:58 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4d9954a1-4e55-4951-befb-3b94e51dd61a tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "cinder-5026e4fa-826d-4589-854e-4446069a1c6f-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:58 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4d9954a1-4e55-4951-befb-3b94e51dd61a tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-5026e4fa-826d-4589-854e-4446069a1c6f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:58 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4d9954a1-4e55-4951-befb-3b94e51dd61a tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "cinder-quobyte-5026e4fa-826d-4589-854e-4446069a1c6f" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:41:58 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-2693969a-77dd-43c8-8e3e-d7d329a1a90e tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.099s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:58 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-2693969a-77dd-43c8-8e3e-d7d329a1a90e tempest-CreateVolumesFromSnapshotTest-116157209 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:41:58 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4d9954a1-4e55-4951-befb-3b94e51dd61a tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-quobyte-5026e4fa-826d-4589-854e-4446069a1c6f" acquired by "delete_volume" :: waited 0.042s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:41:58 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-2693969a-77dd-43c8-8e3e-d7d329a1a90e tempest-CreateVolumesFromSnapshotTest-116157209 None] Deleted volume successfully. Jul 07 17:41:58 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc145eff-c1ec-4560-bde8-b14623625e6b]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4d9954a1-4e55-4951-befb-3b94e51dd61a tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5026e4fa-826d-4589-854e-4446069a1c6f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:58 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-2693969a-77dd-43c8-8e3e-d7d329a1a90e tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-c2b7ba1b-32f7-47b3-bf16-7dcdaebe6be8-delete_volume" released by "delete_volume" :: held 3.776s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:41:58 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-886e6973-c587-4814-a7c6-69526cd193c4 tempest-ProjectReaderTests-1690191251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.bfe58f77-cb61-486d-973d-d3f0e121d5fc" returned: 0 in 1.620s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:58 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-886e6973-c587-4814-a7c6-69526cd193c4 tempest-ProjectReaderTests-1690191251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1e1d8d5-5440-45be-b171-06ce29f36705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:41:58 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[63050baf-b03e-4e74-98c9-67d495df1b43]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:41:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-886e6973-c587-4814-a7c6-69526cd193c4 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:41:59 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5026e4fa-826d-4589-854e-4446069a1c6f Jul 07 17:41:59 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:59 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705 Jul 07 17:41:59 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:41:59 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jul 07 17:41:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-886e6973-c587-4814-a7c6-69526cd193c4 tempest-ProjectReaderTests-1690191251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705" returned: 0 in 1.023s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:41:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-886e6973-c587-4814-a7c6-69526cd193c4 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.bfe58f77-cb61-486d-973d-d3f0e121d5fc {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:00 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.bfe58f77-cb61-486d-973d-d3f0e121d5fc Jul 07 17:42:00 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:00 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4d9954a1-4e55-4951-befb-3b94e51dd61a tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5026e4fa-826d-4589-854e-4446069a1c6f" returned: 0 in 1.220s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4d9954a1-4e55-4951-befb-3b94e51dd61a tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5026e4fa-826d-4589-854e-4446069a1c6f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:00 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5026e4fa-826d-4589-854e-4446069a1c6f Jul 07 17:42:00 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:00 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4d9954a1-4e55-4951-befb-3b94e51dd61a tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-5026e4fa-826d-4589-854e-4446069a1c6f" returned: 0 in 0.896s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:00 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4d9954a1-4e55-4951-befb-3b94e51dd61a tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-quobyte-5026e4fa-826d-4589-854e-4446069a1c6f" released by "delete_volume" :: held 2.202s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:00 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=128,cinder:UPDATE=176,cinder:INSERT=48,cinder:DELETE=18 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:UPDATE=188,cinder:SELECT=126,cinder:INSERT=43,cinder:DELETE=18 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:42:01 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-886e6973-c587-4814-a7c6-69526cd193c4 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.bfe58f77-cb61-486d-973d-d3f0e121d5fc" returned: 0 in 1.087s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-886e6973-c587-4814-a7c6-69526cd193c4 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.bfe58f77-cb61-486d-973d-d3f0e121d5fc {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-4d9954a1-4e55-4951-befb-3b94e51dd61a tempest-CreateVolumesFromSnapshotTest-116157209 None] Created reservations ['e8ae9bd7-1bd1-4f48-845f-84e5b745a4e2', '588a98c4-6c7f-45b5-8ae2-2c19ee4566c3', 'd5f7497a-0eda-4655-b801-2a0ce29b7787', '38fb257c-815a-41d2-861f-0761a4f3b153'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:01 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.bfe58f77-cb61-486d-973d-d3f0e121d5fc Jul 07 17:42:01 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4d9954a1-4e55-4951-befb-3b94e51dd61a tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4d9954a1-4e55-4951-befb-3b94e51dd61a tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4d9954a1-4e55-4951-befb-3b94e51dd61a tempest-CreateVolumesFromSnapshotTest-116157209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4d9954a1-4e55-4951-befb-3b94e51dd61a tempest-CreateVolumesFromSnapshotTest-116157209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4d9954a1-4e55-4951-befb-3b94e51dd61a tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4d9954a1-4e55-4951-befb-3b94e51dd61a tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:01 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:42:01 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Flow 'volume_create_manager' (b8bd9d2f-36fb-44f7-8775-6efd00f3d3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56325172-ce7b-4679-a0bb-24909bd36a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56325172-ce7b-4679-a0bb-24909bd36a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-778222918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f8f594-eee6-4c2f-b132-2ccf0bf45828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d519df5ce8437b91c79b1ce890f0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:02Z,use_quota=True,user_id='d4d732538c704691ad18eea062579f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c9d5dc-babe-4381-b2f2-560bcef73db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c9d5dc-babe-4381-b2f2-560bcef73db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21231a81-0ad9-43b3-8c41-9cd737311a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21231a81-0ad9-43b3-8c41-9cd737311a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88f8f594-eee6-4c2f-b132-2ccf0bf45828', 'volume_name': 'volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80eb3bbe-e8be-4739-98e3-9d860beb11c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80eb3bbe-e8be-4739-98e3-9d860beb11c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a7caa2-f63d-400e-a240-b16ca3d74227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:01 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Volume 88f8f594-eee6-4c2f-b132-2ccf0bf45828: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828', 'volume_size': 1} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-778222918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f8f594-eee6-4c2f-b132-2ccf0bf45828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d519df5ce8437b91c79b1ce890f0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:02Z,use_quota=True,user_id='d4d732538c704691ad18eea062579f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Creating volume 88f8f594-eee6-4c2f-b132-2ccf0bf45828 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:01 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:42:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:01 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 1073741824 Jul 07 17:42:01 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:02 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-886e6973-c587-4814-a7c6-69526cd193c4 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705.bfe58f77-cb61-486d-973d-d3f0e121d5fc" returned: 0 in 0.968s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-886e6973-c587-4814-a7c6-69526cd193c4 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-bfe58f77-cb61-486d-973d-d3f0e121d5fc" released by "_delete_snapshot" :: held 4.907s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-863dfb61-1d61-40e4-8e6b-3b26654dd094 tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "cinder-b26d9838-0538-46b4-935c-c29bcc7967a3-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:02 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-886e6973-c587-4814-a7c6-69526cd193c4 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-d1e1d8d5-5440-45be-b171-06ce29f36705" released by "delete_snapshot" :: held 4.987s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4d9954a1-4e55-4951-befb-3b94e51dd61a tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.946s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:02 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-4d9954a1-4e55-4951-befb-3b94e51dd61a tempest-CreateVolumesFromSnapshotTest-116157209 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:02 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-4d9954a1-4e55-4951-befb-3b94e51dd61a tempest-CreateVolumesFromSnapshotTest-116157209 None] Deleted volume successfully. Jul 07 17:42:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-863dfb61-1d61-40e4-8e6b-3b26654dd094 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-b26d9838-0538-46b4-935c-c29bcc7967a3-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-4d9954a1-4e55-4951-befb-3b94e51dd61a tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-5026e4fa-826d-4589-854e-4446069a1c6f-delete_volume" released by "delete_volume" :: held 3.600s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-863dfb61-1d61-40e4-8e6b-3b26654dd094 tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "cinder-quobyte-b26d9838-0538-46b4-935c-c29bcc7967a3" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-863dfb61-1d61-40e4-8e6b-3b26654dd094 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-quobyte-b26d9838-0538-46b4-935c-c29bcc7967a3" acquired by "delete_volume" :: waited 0.036s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:02 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-886e6973-c587-4814-a7c6-69526cd193c4 tempest-ProjectReaderTests-1690191251 None] Created reservations ['fcd6c772-ca72-4adb-959d-4be228623522', 'fee43be3-9d46-44ce-9ef3-caf3f404c071', '8db56ca8-0d93-47fd-9c89-16719a4754e2', 'a8efbe01-d2ad-4574-984f-74cab0ca63ad'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:02 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece52ae5-8446-4521-9b9c-a3a8dc2a2c1d]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-863dfb61-1d61-40e4-8e6b-3b26654dd094 tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b26d9838-0538-46b4-935c-c29bcc7967a3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:02 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-886e6973-c587-4814-a7c6-69526cd193c4 tempest-ProjectReaderTests-1690191251 None] Delete snapshot completed successfully. Jul 07 17:42:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-886e6973-c587-4814-a7c6-69526cd193c4 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-bfe58f77-cb61-486d-973d-d3f0e121d5fc-delete_snapshot" released by "delete_snapshot" :: held 5.363s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:02 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b26d9838-0538-46b4-935c-c29bcc7967a3 Jul 07 17:42:02 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:03 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 1073741824" returned: 0 in 1.194s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:03 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 Jul 07 17:42:03 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:03 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-863dfb61-1d61-40e4-8e6b-3b26654dd094 tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b26d9838-0538-46b4-935c-c29bcc7967a3" returned: 0 in 1.040s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-863dfb61-1d61-40e4-8e6b-3b26654dd094 tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b26d9838-0538-46b4-935c-c29bcc7967a3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:03 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b26d9838-0538-46b4-935c-c29bcc7967a3 Jul 07 17:42:03 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-398fe5a8-23e1-4944-a3e8-d1f75b9297da tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-d1e1d8d5-5440-45be-b171-06ce29f36705-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-398fe5a8-23e1-4944-a3e8-d1f75b9297da tempest-ProjectReaderTests-1690191251 None] Lock "cinder-d1e1d8d5-5440-45be-b171-06ce29f36705-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-398fe5a8-23e1-4944-a3e8-d1f75b9297da tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-quobyte-d1e1d8d5-5440-45be-b171-06ce29f36705" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-398fe5a8-23e1-4944-a3e8-d1f75b9297da tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-d1e1d8d5-5440-45be-b171-06ce29f36705" acquired by "delete_volume" :: waited 0.031s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:03 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6eeaf67-886c-4a61-8d30-aba50ab84a2f]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-398fe5a8-23e1-4944-a3e8-d1f75b9297da tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:03 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705 Jul 07 17:42:03 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:04 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828" returned: 0 in 0.944s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] <== create_volume: return (2192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:42:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.195s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a7caa2-f63d-400e-a240-b16ca3d74227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d846f3-b8a1-4cce-86d0-c333b9d29d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:04 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Volume volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 (88f8f594-eee6-4c2f-b132-2ccf0bf45828): created successfully Jul 07 17:42:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d846f3-b8a1-4cce-86d0-c333b9d29d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Flow 'volume_create_manager' (b8bd9d2f-36fb-44f7-8775-6efd00f3d3f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:04 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-bbd93b68-6a34-4c7d-b140-105ea3d237fd tempest-VolumeDependencyTests-209927039 None] Created volume successfully. Jul 07 17:42:04 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-863dfb61-1d61-40e4-8e6b-3b26654dd094 tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-b26d9838-0538-46b4-935c-c29bcc7967a3" returned: 0 in 0.809s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:04 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-863dfb61-1d61-40e4-8e6b-3b26654dd094 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-quobyte-b26d9838-0538-46b4-935c-c29bcc7967a3" released by "delete_volume" :: held 1.926s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:04 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-863dfb61-1d61-40e4-8e6b-3b26654dd094 tempest-CreateVolumesFromSnapshotTest-116157209 None] Created reservations ['1c93a4ae-57f5-42e2-bbe5-ff392f263897', '6d223f51-6e6f-4c50-83f5-740b0ad13429', '348e3235-191c-46f4-bbc8-e66a110b8053', '20d6dc27-426e-4bcb-8726-803d9669c06b'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-863dfb61-1d61-40e4-8e6b-3b26654dd094 tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-863dfb61-1d61-40e4-8e6b-3b26654dd094 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-863dfb61-1d61-40e4-8e6b-3b26654dd094 tempest-CreateVolumesFromSnapshotTest-116157209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-863dfb61-1d61-40e4-8e6b-3b26654dd094 tempest-CreateVolumesFromSnapshotTest-116157209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-863dfb61-1d61-40e4-8e6b-3b26654dd094 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-863dfb61-1d61-40e4-8e6b-3b26654dd094 tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:04 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:42:04 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:04 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-398fe5a8-23e1-4944-a3e8-d1f75b9297da tempest-ProjectReaderTests-1690191251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705" returned: 0 in 0.953s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-398fe5a8-23e1-4944-a3e8-d1f75b9297da tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:04 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705 Jul 07 17:42:04 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4763f6da-ee3f-496b-8ad1-86bc0e42fccd tempest-VolumeDependencyTests-209927039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4763f6da-ee3f-496b-8ad1-86bc0e42fccd tempest-VolumeDependencyTests-209927039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-4763f6da-ee3f-496b-8ad1-86bc0e42fccd tempest-VolumeDependencyTests-209927039 None] Creating offline snapshot b6f46aa5-3302-4e41-81db-b99418eb09f2 of volume 88f8f594-eee6-4c2f-b132-2ccf0bf45828 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:42:05 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[a087de0f-056a-4158-aeb0-2fcf963d14c3]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4763f6da-ee3f-496b-8ad1-86bc0e42fccd tempest-VolumeDependencyTests-209927039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:05 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-863dfb61-1d61-40e4-8e6b-3b26654dd094 tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.948s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:05 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-863dfb61-1d61-40e4-8e6b-3b26654dd094 tempest-CreateVolumesFromSnapshotTest-116157209 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:05 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-863dfb61-1d61-40e4-8e6b-3b26654dd094 tempest-CreateVolumesFromSnapshotTest-116157209 None] Deleted volume successfully. Jul 07 17:42:05 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-863dfb61-1d61-40e4-8e6b-3b26654dd094 tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-b26d9838-0538-46b4-935c-c29bcc7967a3-delete_volume" released by "delete_volume" :: held 3.225s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:05 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 Jul 07 17:42:05 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:05 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c0bfb479-6359-49b6-b947-15757b7be7ea tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "cinder-8c03a725-6124-492c-8de0-5ecf6a0cae66-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:05 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c0bfb479-6359-49b6-b947-15757b7be7ea tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-8c03a725-6124-492c-8de0-5ecf6a0cae66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:05 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c0bfb479-6359-49b6-b947-15757b7be7ea tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "cinder-quobyte-84642159-1f24-472c-8464-50bd509bc4d3" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:05 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c0bfb479-6359-49b6-b947-15757b7be7ea tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-quobyte-84642159-1f24-472c-8464-50bd509bc4d3" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:05 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c0bfb479-6359-49b6-b947-15757b7be7ea tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "cinder-quobyte-8c03a725-6124-492c-8de0-5ecf6a0cae66" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:05 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c0bfb479-6359-49b6-b947-15757b7be7ea tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-quobyte-8c03a725-6124-492c-8de0-5ecf6a0cae66" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-c0bfb479-6359-49b6-b947-15757b7be7ea tempest-CreateVolumesFromSnapshotTest-116157209 None] Deleting offline snapshot 8c03a725-6124-492c-8de0-5ecf6a0cae66 of volume 84642159-1f24-472c-8464-50bd509bc4d3 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:42:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-c0bfb479-6359-49b6-b947-15757b7be7ea tempest-CreateVolumesFromSnapshotTest-116157209 None] snapshot_file for this snap is: volume-84642159-1f24-472c-8464-50bd509bc4d3.8c03a725-6124-492c-8de0-5ecf6a0cae66 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:42:05 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c3df9a-149f-400c-b70c-34b7ef7f75d1]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c0bfb479-6359-49b6-b947-15757b7be7ea tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.8c03a725-6124-492c-8de0-5ecf6a0cae66 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:05 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-398fe5a8-23e1-4944-a3e8-d1f75b9297da tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d1e1d8d5-5440-45be-b171-06ce29f36705" returned: 0 in 1.028s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:05 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-398fe5a8-23e1-4944-a3e8-d1f75b9297da tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-d1e1d8d5-5440-45be-b171-06ce29f36705" released by "delete_volume" :: held 2.126s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:05 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.8c03a725-6124-492c-8de0-5ecf6a0cae66 Jul 07 17:42:05 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:05 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-398fe5a8-23e1-4944-a3e8-d1f75b9297da tempest-ProjectReaderTests-1690191251 None] Created reservations ['ef283610-029c-4846-bbef-8e5a10ecf9d3', '1209acb3-eeb7-4bad-b26f-b49521f515e0', '7534a4b3-8215-443f-983c-c3c5b03b55d1', '0ffd4b1f-cacc-43ec-b0db-ed1ca325f0e9'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-398fe5a8-23e1-4944-a3e8-d1f75b9297da tempest-ProjectReaderTests-1690191251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-398fe5a8-23e1-4944-a3e8-d1f75b9297da tempest-ProjectReaderTests-1690191251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-398fe5a8-23e1-4944-a3e8-d1f75b9297da tempest-ProjectReaderTests-1690191251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-398fe5a8-23e1-4944-a3e8-d1f75b9297da tempest-ProjectReaderTests-1690191251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-398fe5a8-23e1-4944-a3e8-d1f75b9297da tempest-ProjectReaderTests-1690191251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-398fe5a8-23e1-4944-a3e8-d1f75b9297da tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:06 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:42:06 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:06 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4763f6da-ee3f-496b-8ad1-86bc0e42fccd tempest-VolumeDependencyTests-209927039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828" returned: 0 in 1.086s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4763f6da-ee3f-496b-8ad1-86bc0e42fccd tempest-VolumeDependencyTests-209927039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.b6f46aa5-3302-4e41-81db-b99418eb09f2 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:06 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.b6f46aa5-3302-4e41-81db-b99418eb09f2 1G Jul 07 17:42:06 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:06 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c0bfb479-6359-49b6-b947-15757b7be7ea tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.8c03a725-6124-492c-8de0-5ecf6a0cae66" returned: 0 in 1.227s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-c0bfb479-6359-49b6-b947-15757b7be7ea tempest-CreateVolumesFromSnapshotTest-116157209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84642159-1f24-472c-8464-50bd509bc4d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:42:06 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[9161b027-a3e3-44ad-b4f5-d8e742a7b23d]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c0bfb479-6359-49b6-b947-15757b7be7ea tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:07 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3 Jul 07 17:42:07 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:07 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-398fe5a8-23e1-4944-a3e8-d1f75b9297da tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.885s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:07 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-398fe5a8-23e1-4944-a3e8-d1f75b9297da tempest-ProjectReaderTests-1690191251 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:07 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-398fe5a8-23e1-4944-a3e8-d1f75b9297da tempest-ProjectReaderTests-1690191251 None] Deleted volume successfully. Jul 07 17:42:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-398fe5a8-23e1-4944-a3e8-d1f75b9297da tempest-ProjectReaderTests-1690191251 None] Lock "cinder-d1e1d8d5-5440-45be-b171-06ce29f36705-delete_volume" released by "delete_volume" :: held 3.581s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:07 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4763f6da-ee3f-496b-8ad1-86bc0e42fccd tempest-VolumeDependencyTests-209927039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.b6f46aa5-3302-4e41-81db-b99418eb09f2 1G" returned: 0 in 1.217s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4763f6da-ee3f-496b-8ad1-86bc0e42fccd tempest-VolumeDependencyTests-209927039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.b6f46aa5-3302-4e41-81db-b99418eb09f2 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:07 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.b6f46aa5-3302-4e41-81db-b99418eb09f2 Jul 07 17:42:07 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:07 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Flow 'volume_create_manager' (e4cffb2c-55a2-403b-81f3-bba1d527ccb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097de000-3d69-4d8b-b352-a63546fb8db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097de000-3d69-4d8b-b352-a63546fb8db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1517009197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27fda020-13d8-42ea-b7e0-f23abfd53c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ac77c0e4184ec79759fdc2759452f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:08Z,use_quota=True,user_id='432b342bf7cf42968fe570ca1f4ae255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f1f474-7ae5-4a19-8c99-aa2dcffbed4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f1f474-7ae5-4a19-8c99-aa2dcffbed4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f09261f2-560c-412a-b98b-3db251d91194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f09261f2-560c-412a-b98b-3db251d91194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27fda020-13d8-42ea-b7e0-f23abfd53c73', 'volume_name': 'volume-27fda020-13d8-42ea-b7e0-f23abfd53c73', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1586103a-d159-4534-8405-5d295f5563d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1586103a-d159-4534-8405-5d295f5563d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:07 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35cdecf5-794b-4cb1-a86c-161fee95c69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:07 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Volume 27fda020-13d8-42ea-b7e0-f23abfd53c73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27fda020-13d8-42ea-b7e0-f23abfd53c73', 'volume_size': 1} Jul 07 17:42:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:08 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c0bfb479-6359-49b6-b947-15757b7be7ea tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3" returned: 0 in 1.100s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c0bfb479-6359-49b6-b947-15757b7be7ea tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.8c03a725-6124-492c-8de0-5ecf6a0cae66 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:08 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.8c03a725-6124-492c-8de0-5ecf6a0cae66 Jul 07 17:42:08 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:08 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4763f6da-ee3f-496b-8ad1-86bc0e42fccd tempest-VolumeDependencyTests-209927039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.b6f46aa5-3302-4e41-81db-b99418eb09f2" returned: 0 in 0.973s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:08 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-4763f6da-ee3f-496b-8ad1-86bc0e42fccd tempest-VolumeDependencyTests-209927039 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.b6f46aa5-3302-4e41-81db-b99418eb09f2 is being set with open permissions: ugo+rw Jul 07 17:42:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4763f6da-ee3f-496b-8ad1-86bc0e42fccd tempest-VolumeDependencyTests-209927039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.b6f46aa5-3302-4e41-81db-b99418eb09f2 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:08 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.b6f46aa5-3302-4e41-81db-b99418eb09f2 Jul 07 17:42:08 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:09 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c0bfb479-6359-49b6-b947-15757b7be7ea tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.8c03a725-6124-492c-8de0-5ecf6a0cae66" returned: 0 in 0.959s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c0bfb479-6359-49b6-b947-15757b7be7ea tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.8c03a725-6124-492c-8de0-5ecf6a0cae66 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:09 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.8c03a725-6124-492c-8de0-5ecf6a0cae66 Jul 07 17:42:09 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:09 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4763f6da-ee3f-496b-8ad1-86bc0e42fccd tempest-VolumeDependencyTests-209927039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.b6f46aa5-3302-4e41-81db-b99418eb09f2" returned: 0 in 0.763s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4763f6da-ee3f-496b-8ad1-86bc0e42fccd tempest-VolumeDependencyTests-209927039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:09 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.info Jul 07 17:42:09 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:09 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c0bfb479-6359-49b6-b947-15757b7be7ea tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3.8c03a725-6124-492c-8de0-5ecf6a0cae66" returned: 0 in 0.735s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:09 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c0bfb479-6359-49b6-b947-15757b7be7ea tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-quobyte-8c03a725-6124-492c-8de0-5ecf6a0cae66" released by "_delete_snapshot" :: held 4.199s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:09 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c0bfb479-6359-49b6-b947-15757b7be7ea tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-quobyte-84642159-1f24-472c-8464-50bd509bc4d3" released by "delete_snapshot" :: held 4.237s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:09 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-c0bfb479-6359-49b6-b947-15757b7be7ea tempest-CreateVolumesFromSnapshotTest-116157209 None] Created reservations ['2442e19b-2866-4d47-8489-2c11edc57b4e', '033a1966-bb5f-4ce1-bb42-e71794f142da', '99b42370-390c-464f-ac94-539996f7defa', '61dbe23d-f9ed-47a2-ae97-53874ec7e68b'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:10 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-c0bfb479-6359-49b6-b947-15757b7be7ea tempest-CreateVolumesFromSnapshotTest-116157209 None] Delete snapshot completed successfully. Jul 07 17:42:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c0bfb479-6359-49b6-b947-15757b7be7ea tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-8c03a725-6124-492c-8de0-5ecf6a0cae66-delete_snapshot" released by "delete_snapshot" :: held 4.443s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:10 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4763f6da-ee3f-496b-8ad1-86bc0e42fccd tempest-VolumeDependencyTests-209927039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.info" returned: 0 in 0.877s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:10 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-4763f6da-ee3f-496b-8ad1-86bc0e42fccd tempest-VolumeDependencyTests-209927039 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.info is being set with open permissions: ugo+rw Jul 07 17:42:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4763f6da-ee3f-496b-8ad1-86bc0e42fccd tempest-VolumeDependencyTests-209927039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:10 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.info Jul 07 17:42:10 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-09f16ddf-8d45-4e54-9422-e049ccc8dd1b tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "cinder-84642159-1f24-472c-8464-50bd509bc4d3-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-09f16ddf-8d45-4e54-9422-e049ccc8dd1b tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-84642159-1f24-472c-8464-50bd509bc4d3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-09f16ddf-8d45-4e54-9422-e049ccc8dd1b tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "cinder-quobyte-84642159-1f24-472c-8464-50bd509bc4d3" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:11 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-09f16ddf-8d45-4e54-9422-e049ccc8dd1b tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-quobyte-84642159-1f24-472c-8464-50bd509bc4d3" acquired by "delete_volume" :: waited 0.023s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:11 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ce7ab0-a2ab-4cd6-b5e8-6c1fb0498862]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-09f16ddf-8d45-4e54-9422-e049ccc8dd1b tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:11 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4763f6da-ee3f-496b-8ad1-86bc0e42fccd tempest-VolumeDependencyTests-209927039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.info" returned: 0 in 0.816s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4763f6da-ee3f-496b-8ad1-86bc0e42fccd tempest-VolumeDependencyTests-209927039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.902s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.329s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1517009197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27fda020-13d8-42ea-b7e0-f23abfd53c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ac77c0e4184ec79759fdc2759452f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:08Z,use_quota=True,user_id='432b342bf7cf42968fe570ca1f4ae255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:42:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Creating volume 27fda020-13d8-42ea-b7e0-f23abfd53c73 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:42:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:11 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:42:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:11 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73 1073741824 Jul 07 17:42:11 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:11 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3 Jul 07 17:42:11 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:11 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-4763f6da-ee3f-496b-8ad1-86bc0e42fccd tempest-VolumeDependencyTests-209927039 None] Create snapshot completed successfully Jul 07 17:42:12 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-09f16ddf-8d45-4e54-9422-e049ccc8dd1b tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3" returned: 0 in 1.003s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-09f16ddf-8d45-4e54-9422-e049ccc8dd1b tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:12 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3 Jul 07 17:42:12 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:12 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Flow 'volume_create_manager' (d1be9f94-5d06-46cb-bb13-a958ddb8f9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:12 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4d3656-898f-47ba-9b6f-1535954e9294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73 1073741824" returned: 0 in 1.332s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4d3656-898f-47ba-9b6f-1535954e9294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1292983038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b1ceafa-213b-4926-9c45-22c5847466a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d519df5ce8437b91c79b1ce890f0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b6f46aa5-3302-4e41-81db-b99418eb09f2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:12Z,use_quota=True,user_id='d4d732538c704691ad18eea062579f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a50d0c2-51b9-41e9-aff9-fa06b5cdb424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a50d0c2-51b9-41e9-aff9-fa06b5cdb424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b30f2dd3-18e3-48f9-9970-8e742c36ca52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b30f2dd3-18e3-48f9-9970-8e742c36ca52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8b1ceafa-213b-4926-9c45-22c5847466a7', 'volume_name': 'volume-8b1ceafa-213b-4926-9c45-22c5847466a7', 'volume_size': 1, 'snapshot_id': 'b6f46aa5-3302-4e41-81db-b99418eb09f2'}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b081bf-248f-4066-8d75-5f12054339a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b081bf-248f-4066-8d75-5f12054339a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:12 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe83dea2-4994-4cbc-b413-4f6d3e524630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:12 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Volume 8b1ceafa-213b-4926-9c45-22c5847466a7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8b1ceafa-213b-4926-9c45-22c5847466a7', 'volume_size': 1, 'snapshot_id': 'b6f46aa5-3302-4e41-81db-b99418eb09f2'} Jul 07 17:42:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:12 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73 Jul 07 17:42:12 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:13 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-09f16ddf-8d45-4e54-9422-e049ccc8dd1b tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-84642159-1f24-472c-8464-50bd509bc4d3" returned: 0 in 0.926s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-09f16ddf-8d45-4e54-9422-e049ccc8dd1b tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-quobyte-84642159-1f24-472c-8464-50bd509bc4d3" released by "delete_volume" :: held 2.019s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-09f16ddf-8d45-4e54-9422-e049ccc8dd1b tempest-CreateVolumesFromSnapshotTest-116157209 None] Created reservations ['f668e271-463e-477c-9aee-0ea855694de5', 'e3b05758-8f43-42ea-b784-35a74d21e0db', 'd51c6519-f85c-42e2-880f-e565ec161a5b', '694019b5-7bf9-4150-be93-d9bae77461f7'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-09f16ddf-8d45-4e54-9422-e049ccc8dd1b tempest-CreateVolumesFromSnapshotTest-116157209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-09f16ddf-8d45-4e54-9422-e049ccc8dd1b tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-09f16ddf-8d45-4e54-9422-e049ccc8dd1b tempest-CreateVolumesFromSnapshotTest-116157209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-09f16ddf-8d45-4e54-9422-e049ccc8dd1b tempest-CreateVolumesFromSnapshotTest-116157209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-09f16ddf-8d45-4e54-9422-e049ccc8dd1b tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-09f16ddf-8d45-4e54-9422-e049ccc8dd1b tempest-CreateVolumesFromSnapshotTest-116157209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:13 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:42:13 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:13 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73" returned: 0 in 0.819s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] <== create_volume: return (2276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.281s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.861s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Acquiring lock "cinder-quobyte-b6f46aa5-3302-4e41-81db-b99418eb09f2-8b1ceafa-213b-4926-9c45-22c5847466a7" by "_create_volume_from_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35cdecf5-794b-4cb1-a86c-161fee95c69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27fda020-13d8-42ea-b7e0-f23abfd53c73', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e0f89c-d909-4857-a426-b76355c249d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:13 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Volume volume-27fda020-13d8-42ea-b7e0-f23abfd53c73 (27fda020-13d8-42ea-b7e0-f23abfd53c73): created successfully Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e0f89c-d909-4857-a426-b76355c249d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Flow 'volume_create_manager' (e4cffb2c-55a2-403b-81f3-bba1d527ccb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Lock "cinder-quobyte-b6f46aa5-3302-4e41-81db-b99418eb09f2-8b1ceafa-213b-4926-9c45-22c5847466a7" acquired by "_create_volume_from_snapshot" :: waited 0.071s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Creating volume 8b1ceafa-213b-4926-9c45-22c5847466a7 from snapshot b6f46aa5-3302-4e41-81db-b99418eb09f2 {{(pid=87303) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Acquiring lock "cinder-quobyte-8b1ceafa-213b-4926-9c45-22c5847466a7" by "_copy_volume_from_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:13 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-bc9b6663-9221-4999-a8ff-f06eb1d71453 tempest-ProjectReaderTests-1690191251 None] Created volume successfully. Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Lock "cinder-quobyte-8b1ceafa-213b-4926-9c45-22c5847466a7" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] snapshot: b6f46aa5-3302-4e41-81db-b99418eb09f2, volume: 8b1ceafa-213b-4926-9c45-22c5847466a7, {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff146c0-115d-4dca-99f8-bea685c39641]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.b6f46aa5-3302-4e41-81db-b99418eb09f2 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:13 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.b6f46aa5-3302-4e41-81db-b99418eb09f2 Jul 07 17:42:13 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:14 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-09f16ddf-8d45-4e54-9422-e049ccc8dd1b tempest-CreateVolumesFromSnapshotTest-116157209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.091s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:14 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-09f16ddf-8d45-4e54-9422-e049ccc8dd1b tempest-CreateVolumesFromSnapshotTest-116157209 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:14 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-09f16ddf-8d45-4e54-9422-e049ccc8dd1b tempest-CreateVolumesFromSnapshotTest-116157209 None] Deleted volume successfully. Jul 07 17:42:14 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-09f16ddf-8d45-4e54-9422-e049ccc8dd1b tempest-CreateVolumesFromSnapshotTest-116157209 None] Lock "cinder-84642159-1f24-472c-8464-50bd509bc4d3-delete_volume" released by "delete_volume" :: held 3.437s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3b19eb6c-b55f-4ab7-af7e-91e6bfeeaaa3 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:14 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.b6f46aa5-3302-4e41-81db-b99418eb09f2" returned: 0 in 1.217s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:42:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:42:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Creating direct copy from snapshot {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:42:14 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe73bc84-aa4a-4578-89a8-8a4337736a6a]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:15 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 Jul 07 17:42:15 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:15 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828" returned: 0 in 0.977s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:15 devstack cinder-volume[87303]: DEBUG cinder.utils [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Path /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8b1ceafa-213b-4926-9c45-22c5847466a7 not found in is_blk_device check {{(pid=87303) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:42:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8b1ceafa-213b-4926-9c45-22c5847466a7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:15 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8b1ceafa-213b-4926-9c45-22c5847466a7 Jul 07 17:42:15 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:21 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8b1ceafa-213b-4926-9c45-22c5847466a7" returned: 0 in 6.049s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:21 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcabdcc-0839-4f50-b4e8-f8273603f0bd]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:22 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 Jul 07 17:42:22 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:23 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828" returned: 0 in 1.127s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:23 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Image conversion details: src /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8b1ceafa-213b-4926-9c45-22c5847466a7 {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:42:23 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Converted 1024.00 MB image at 169.24 MB/s Jul 07 17:42:23 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8b1ceafa-213b-4926-9c45-22c5847466a7 is being set with open permissions: ugo+rw Jul 07 17:42:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8b1ceafa-213b-4926-9c45-22c5847466a7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:23 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8b1ceafa-213b-4926-9c45-22c5847466a7 Jul 07 17:42:23 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:23 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Flow 'volume_create_manager' (c4f83db1-df8a-4a18-bfd3-6f841525544a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f294e5-ade1-4e2d-a3d9-73e8595ee245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f294e5-ade1-4e2d-a3d9-73e8595ee245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7378197-aab3-4206-b108-4190a0a8dd07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45bf3f79ff534ad5914dd99b0c8f86cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:23Z,use_quota=True,user_id='47b973606d924f4e894823e6573f4e28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0fe964-c4fa-41ac-8380-9a3ac3071859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0fe964-c4fa-41ac-8380-9a3ac3071859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cead0668-8c54-41d6-bd0f-06e1eb4637ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:23 devstack cinder-volume[87303]: DEBUG cinder.image.glance [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Creating Keystone auth plugin from conf {{(pid=87303) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:42:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cead0668-8c54-41d6-bd0f-06e1eb4637ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd7378197-aab3-4206-b108-4190a0a8dd07', 'volume_name': 'volume-d7378197-aab3-4206-b108-4190a0a8dd07', 'volume_size': 1, 'image_id': '00a03fd0-33dc-4388-94df-62a806c20697', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00a03fd0-33dc-4388-94df-62a806c20697', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6acd9183d3b05f58eb7be7e0e4a01423', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '45bf3f79ff534ad5914dd99b0c8f86cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7d4de67489d3499cb407c76e0636f6920dcd7e54454318e8418515c1b7790557d783d59b089e48c5c5fabcf031a3c3a40396810d06fb68daab2812ff96b2d299', 'id': '00a03fd0-33dc-4388-94df-62a806c20697', 'created_at': datetime.datetime(2026, 7, 7, 15, 42, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 42, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00a03fd0-33dc-4388-94df-62a806c20697/file', 'properties': {}}, 'image_service': }' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511bf45a-5d13-4b94-91bf-a4ba0a05846b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511bf45a-5d13-4b94-91bf-a4ba0a05846b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:23 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6f2c1e1-de84-488e-aec4-35f55ca50906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:23 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Volume d7378197-aab3-4206-b108-4190a0a8dd07: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d7378197-aab3-4206-b108-4190a0a8dd07', 'volume_size': 1, 'image_id': '00a03fd0-33dc-4388-94df-62a806c20697', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00a03fd0-33dc-4388-94df-62a806c20697', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6acd9183d3b05f58eb7be7e0e4a01423', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '45bf3f79ff534ad5914dd99b0c8f86cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7d4de67489d3499cb407c76e0636f6920dcd7e54454318e8418515c1b7790557d783d59b089e48c5c5fabcf031a3c3a40396810d06fb68daab2812ff96b2d299', 'id': '00a03fd0-33dc-4388-94df-62a806c20697', 'created_at': datetime.datetime(2026, 7, 7, 15, 42, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 42, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00a03fd0-33dc-4388-94df-62a806c20697/file', 'properties': {}}, 'image_service': } Jul 07 17:42:23 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Trying to clone d7378197-aab3-4206-b108-4190a0a8dd07 from image 00a03fd0-33dc-4388-94df-62a806c20697 at location (None, [{'url': 'file:///opt/stack/data/glance/images/00a03fd0-33dc-4388-94df-62a806c20697', 'metadata': {}}]). {{(pid=87303) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 17:42:23 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8b1ceafa-213b-4926-9c45-22c5847466a7" returned: 0 in 0.845s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:23 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Lock "cinder-quobyte-8b1ceafa-213b-4926-9c45-22c5847466a7" released by "_copy_volume_from_snapshot" :: held 10.352s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:23 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Lock "cinder-quobyte-b6f46aa5-3302-4e41-81db-b99418eb09f2-8b1ceafa-213b-4926-9c45-22c5847466a7" released by "_create_volume_from_snapshot" :: held 10.415s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.488s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3b19eb6c-b55f-4ab7-af7e-91e6bfeeaaa3 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.282s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:24 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-3b19eb6c-b55f-4ab7-af7e-91e6bfeeaaa3 tempest-ProjectReaderTests-1690191251 None] Creating offline snapshot a041a8b2-3930-4ce2-8a8f-207b48fe3bc6 of volume 27fda020-13d8-42ea-b7e0-f23abfd53c73 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:42:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe83dea2-4994-4cbc-b413-4f6d3e524630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b1ceafa-213b-4926-9c45-22c5847466a7', 'volume_size': 1, 'snapshot_id': 'b6f46aa5-3302-4e41-81db-b99418eb09f2'}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3299401e-163a-47d3-872c-89ad8f557222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:24 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[54afbb28-013f-4e33-b93b-67fbb639b72b]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3b19eb6c-b55f-4ab7-af7e-91e6bfeeaaa3 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:24 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Volume volume-8b1ceafa-213b-4926-9c45-22c5847466a7 (8b1ceafa-213b-4926-9c45-22c5847466a7): created successfully Jul 07 17:42:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3299401e-163a-47d3-872c-89ad8f557222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Flow 'volume_create_manager' (d1be9f94-5d06-46cb-bb13-a958ddb8f9f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:24 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:42:24 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Image download 0.00 MB at 0.00 MB/s Jul 07 17:42:24 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5df719e9-d036-49d0-8a2e-d1a7f7aec03d tempest-VolumeDependencyTests-209927039 None] Created volume successfully. Jul 07 17:42:24 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cd8546-f88b-444c-a29b-f269d440b4f8]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:24 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73 Jul 07 17:42:24 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:24 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD Jul 07 17:42:24 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6159beff-6367-4e9a-9ebf-6524231a3e67 tempest-VolumeDependencyTests-209927039 None] Acquiring lock "cinder-b6f46aa5-3302-4e41-81db-b99418eb09f2-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6159beff-6367-4e9a-9ebf-6524231a3e67 tempest-VolumeDependencyTests-209927039 None] Lock "cinder-b6f46aa5-3302-4e41-81db-b99418eb09f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6159beff-6367-4e9a-9ebf-6524231a3e67 tempest-VolumeDependencyTests-209927039 None] Acquiring lock "cinder-quobyte-88f8f594-eee6-4c2f-b132-2ccf0bf45828" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6159beff-6367-4e9a-9ebf-6524231a3e67 tempest-VolumeDependencyTests-209927039 None] Lock "cinder-quobyte-88f8f594-eee6-4c2f-b132-2ccf0bf45828" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6159beff-6367-4e9a-9ebf-6524231a3e67 tempest-VolumeDependencyTests-209927039 None] Acquiring lock "cinder-quobyte-b6f46aa5-3302-4e41-81db-b99418eb09f2" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6159beff-6367-4e9a-9ebf-6524231a3e67 tempest-VolumeDependencyTests-209927039 None] Lock "cinder-quobyte-b6f46aa5-3302-4e41-81db-b99418eb09f2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:24 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-6159beff-6367-4e9a-9ebf-6524231a3e67 tempest-VolumeDependencyTests-209927039 None] Deleting offline snapshot b6f46aa5-3302-4e41-81db-b99418eb09f2 of volume 88f8f594-eee6-4c2f-b132-2ccf0bf45828 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:42:24 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-6159beff-6367-4e9a-9ebf-6524231a3e67 tempest-VolumeDependencyTests-209927039 None] snapshot_file for this snap is: volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.b6f46aa5-3302-4e41-81db-b99418eb09f2 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:42:24 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1594c5-8007-41be-8baf-4e7ff708f6cb]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6159beff-6367-4e9a-9ebf-6524231a3e67 tempest-VolumeDependencyTests-209927039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.b6f46aa5-3302-4e41-81db-b99418eb09f2 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:25 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:25 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.b6f46aa5-3302-4e41-81db-b99418eb09f2 Jul 07 17:42:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3b19eb6c-b55f-4ab7-af7e-91e6bfeeaaa3 tempest-ProjectReaderTests-1690191251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73" returned: 0 in 0.997s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:25 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3b19eb6c-b55f-4ab7-af7e-91e6bfeeaaa3 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.a041a8b2-3930-4ce2-8a8f-207b48fe3bc6 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:25 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.a041a8b2-3930-4ce2-8a8f-207b48fe3bc6 1G Jul 07 17:42:25 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:25 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:25 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Flow 'volume_create_manager' (d605be27-f3df-4895-aebe-013fddf0b1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba69500-9750-419f-bf97-a956bc040d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD" returned: 0 in 1.097s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba69500-9750-419f-bf97-a956bc040d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-58678624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f37c39f-8114-4692-a135-0ac50629bb00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09c3d033da24c16bbcaed97af3e5e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:25Z,use_quota=True,user_id='b7bc2b5958a04f199734c1be8706af05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52061909-64a4-41f9-a35f-4ade06c2e225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52061909-64a4-41f9-a35f-4ade06c2e225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55efa762-43c2-4e29-a9d6-7ed37319e69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55efa762-43c2-4e29-a9d6-7ed37319e69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f37c39f-8114-4692-a135-0ac50629bb00', 'volume_name': 'volume-4f37c39f-8114-4692-a135-0ac50629bb00', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335462bd-2216-43ec-8c66-fefa83e520b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335462bd-2216-43ec-8c66-fefa83e520b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:25 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc267fa-c8be-4286-9837-90bb767e02f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:25 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Volume 4f37c39f-8114-4692-a135-0ac50629bb00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f37c39f-8114-4692-a135-0ac50629bb00', 'volume_size': 1} Jul 07 17:42:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:25 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD Jul 07 17:42:25 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:25 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6159beff-6367-4e9a-9ebf-6524231a3e67 tempest-VolumeDependencyTests-209927039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.b6f46aa5-3302-4e41-81db-b99418eb09f2" returned: 0 in 0.946s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-6159beff-6367-4e9a-9ebf-6524231a3e67 tempest-VolumeDependencyTests-209927039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:42:25 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e8f49e-e710-4f63-be4a-03b480561f97]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6159beff-6367-4e9a-9ebf-6524231a3e67 tempest-VolumeDependencyTests-209927039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:26 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 Jul 07 17:42:26 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:26 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3b19eb6c-b55f-4ab7-af7e-91e6bfeeaaa3 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.a041a8b2-3930-4ce2-8a8f-207b48fe3bc6 1G" returned: 0 in 0.932s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3b19eb6c-b55f-4ab7-af7e-91e6bfeeaaa3 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27fda020-13d8-42ea-b7e0-f23abfd53c73 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.a041a8b2-3930-4ce2-8a8f-207b48fe3bc6 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:26 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27fda020-13d8-42ea-b7e0-f23abfd53c73 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.a041a8b2-3930-4ce2-8a8f-207b48fe3bc6 Jul 07 17:42:26 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:26 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD" returned: 1 in 0.872s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:42:26 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Temporary image 00a03fd0-33dc-4388-94df-62a806c20697 is fetched for user 47b973606d924f4e894823e6573f4e28. {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:42:26 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[688c63fe-437f-485b-a0a0-52ec67d68be2]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:26 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD Jul 07 17:42:26 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:26 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6159beff-6367-4e9a-9ebf-6524231a3e67 tempest-VolumeDependencyTests-209927039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828" returned: 0 in 0.896s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6159beff-6367-4e9a-9ebf-6524231a3e67 tempest-VolumeDependencyTests-209927039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.b6f46aa5-3302-4e41-81db-b99418eb09f2 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:26 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3b19eb6c-b55f-4ab7-af7e-91e6bfeeaaa3 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27fda020-13d8-42ea-b7e0-f23abfd53c73 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.a041a8b2-3930-4ce2-8a8f-207b48fe3bc6" returned: 0 in 0.771s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:26 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-3b19eb6c-b55f-4ab7-af7e-91e6bfeeaaa3 tempest-ProjectReaderTests-1690191251 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.a041a8b2-3930-4ce2-8a8f-207b48fe3bc6 is being set with open permissions: ugo+rw Jul 07 17:42:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3b19eb6c-b55f-4ab7-af7e-91e6bfeeaaa3 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.a041a8b2-3930-4ce2-8a8f-207b48fe3bc6 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:26 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.b6f46aa5-3302-4e41-81db-b99418eb09f2 Jul 07 17:42:26 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:26 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.a041a8b2-3930-4ce2-8a8f-207b48fe3bc6 Jul 07 17:42:26 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:27 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD" returned: 0 in 0.882s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:27 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD Jul 07 17:42:27 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:27 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3b19eb6c-b55f-4ab7-af7e-91e6bfeeaaa3 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.a041a8b2-3930-4ce2-8a8f-207b48fe3bc6" returned: 0 in 0.688s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3b19eb6c-b55f-4ab7-af7e-91e6bfeeaaa3 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:27 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.info Jul 07 17:42:27 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:27 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6159beff-6367-4e9a-9ebf-6524231a3e67 tempest-VolumeDependencyTests-209927039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.b6f46aa5-3302-4e41-81db-b99418eb09f2" returned: 0 in 0.821s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6159beff-6367-4e9a-9ebf-6524231a3e67 tempest-VolumeDependencyTests-209927039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.b6f46aa5-3302-4e41-81db-b99418eb09f2 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:27 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.b6f46aa5-3302-4e41-81db-b99418eb09f2 Jul 07 17:42:27 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:28 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD" returned: 1 in 0.889s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:42:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:28 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3b19eb6c-b55f-4ab7-af7e-91e6bfeeaaa3 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.info" returned: 0 in 0.741s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:28 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-3b19eb6c-b55f-4ab7-af7e-91e6bfeeaaa3 tempest-ProjectReaderTests-1690191251 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.info is being set with open permissions: ugo+rw Jul 07 17:42:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3b19eb6c-b55f-4ab7-af7e-91e6bfeeaaa3 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:28 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:28 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.info Jul 07 17:42:28 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6159beff-6367-4e9a-9ebf-6524231a3e67 tempest-VolumeDependencyTests-209927039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828.b6f46aa5-3302-4e41-81db-b99418eb09f2" returned: 0 in 0.700s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6159beff-6367-4e9a-9ebf-6524231a3e67 tempest-VolumeDependencyTests-209927039 None] Lock "cinder-quobyte-b6f46aa5-3302-4e41-81db-b99418eb09f2" released by "_delete_snapshot" :: held 3.489s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6159beff-6367-4e9a-9ebf-6524231a3e67 tempest-VolumeDependencyTests-209927039 None] Lock "cinder-quobyte-88f8f594-eee6-4c2f-b132-2ccf0bf45828" released by "delete_snapshot" :: held 3.518s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:28 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-6159beff-6367-4e9a-9ebf-6524231a3e67 tempest-VolumeDependencyTests-209927039 None] Created reservations ['fcfc7dcc-f021-4aba-9e86-924dbd85ef4b', '7bdf1dd5-7c6d-4470-b80a-5f4666d93998', '85f8eaa6-9d03-4e7e-b2b0-1d9eca4d8488', 'e7edd07e-4433-439f-bcda-56b6496dc2d8'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:28 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-6159beff-6367-4e9a-9ebf-6524231a3e67 tempest-VolumeDependencyTests-209927039 None] Delete snapshot completed successfully. Jul 07 17:42:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6159beff-6367-4e9a-9ebf-6524231a3e67 tempest-VolumeDependencyTests-209927039 None] Lock "cinder-b6f46aa5-3302-4e41-81db-b99418eb09f2-delete_snapshot" released by "delete_snapshot" :: held 3.678s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:28 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3b19eb6c-b55f-4ab7-af7e-91e6bfeeaaa3 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.info" returned: 0 in 0.731s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3b19eb6c-b55f-4ab7-af7e-91e6bfeeaaa3 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.062s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.662s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-58678624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f37c39f-8114-4692-a135-0ac50629bb00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09c3d033da24c16bbcaed97af3e5e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:25Z,use_quota=True,user_id='b7bc2b5958a04f199734c1be8706af05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Creating volume 4f37c39f-8114-4692-a135-0ac50629bb00 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:29 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f37c39f-8114-4692-a135-0ac50629bb00 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d7ea20a5-247d-4831-9e2f-578ee661ee3a tempest-VolumeDependencyTests-209927039 None] Acquiring lock "cinder-88f8f594-eee6-4c2f-b132-2ccf0bf45828-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:29 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f37c39f-8114-4692-a135-0ac50629bb00 1073741824 Jul 07 17:42:29 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d7ea20a5-247d-4831-9e2f-578ee661ee3a tempest-VolumeDependencyTests-209927039 None] Lock "cinder-88f8f594-eee6-4c2f-b132-2ccf0bf45828-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:29 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-3b19eb6c-b55f-4ab7-af7e-91e6bfeeaaa3 tempest-ProjectReaderTests-1690191251 None] Create snapshot completed successfully Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d7ea20a5-247d-4831-9e2f-578ee661ee3a tempest-VolumeDependencyTests-209927039 None] Acquiring lock "cinder-quobyte-88f8f594-eee6-4c2f-b132-2ccf0bf45828" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d7ea20a5-247d-4831-9e2f-578ee661ee3a tempest-VolumeDependencyTests-209927039 None] Lock "cinder-quobyte-88f8f594-eee6-4c2f-b132-2ccf0bf45828" acquired by "delete_volume" :: waited 0.014s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f42fd5-38c1-490b-b7c9-c4e8847cda3b]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d7ea20a5-247d-4831-9e2f-578ee661ee3a tempest-VolumeDependencyTests-209927039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:29 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 Jul 07 17:42:29 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-eee46b8a-7413-45e8-9efc-c4810017a946 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-a041a8b2-3930-4ce2-8a8f-207b48fe3bc6-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-eee46b8a-7413-45e8-9efc-c4810017a946 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-a041a8b2-3930-4ce2-8a8f-207b48fe3bc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-eee46b8a-7413-45e8-9efc-c4810017a946 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-quobyte-27fda020-13d8-42ea-b7e0-f23abfd53c73" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-eee46b8a-7413-45e8-9efc-c4810017a946 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-27fda020-13d8-42ea-b7e0-f23abfd53c73" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-eee46b8a-7413-45e8-9efc-c4810017a946 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-quobyte-a041a8b2-3930-4ce2-8a8f-207b48fe3bc6" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-eee46b8a-7413-45e8-9efc-c4810017a946 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-a041a8b2-3930-4ce2-8a8f-207b48fe3bc6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-eee46b8a-7413-45e8-9efc-c4810017a946 tempest-ProjectReaderTests-1690191251 None] Deleting offline snapshot a041a8b2-3930-4ce2-8a8f-207b48fe3bc6 of volume 27fda020-13d8-42ea-b7e0-f23abfd53c73 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-eee46b8a-7413-45e8-9efc-c4810017a946 tempest-ProjectReaderTests-1690191251 None] snapshot_file for this snap is: volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.a041a8b2-3930-4ce2-8a8f-207b48fe3bc6 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1725a7-d1a1-4051-a558-2965bfec68e5]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-eee46b8a-7413-45e8-9efc-c4810017a946 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.a041a8b2-3930-4ce2-8a8f-207b48fe3bc6 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:29 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.a041a8b2-3930-4ce2-8a8f-207b48fe3bc6 Jul 07 17:42:29 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:30 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f37c39f-8114-4692-a135-0ac50629bb00 1073741824" returned: 0 in 1.001s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:30 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d7ea20a5-247d-4831-9e2f-578ee661ee3a tempest-VolumeDependencyTests-209927039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828" returned: 0 in 0.872s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d7ea20a5-247d-4831-9e2f-578ee661ee3a tempest-VolumeDependencyTests-209927039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f37c39f-8114-4692-a135-0ac50629bb00 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:30 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828 Jul 07 17:42:30 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:30 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f37c39f-8114-4692-a135-0ac50629bb00 Jul 07 17:42:30 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:30 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-eee46b8a-7413-45e8-9efc-c4810017a946 tempest-ProjectReaderTests-1690191251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.a041a8b2-3930-4ce2-8a8f-207b48fe3bc6" returned: 0 in 0.845s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-eee46b8a-7413-45e8-9efc-c4810017a946 tempest-ProjectReaderTests-1690191251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27fda020-13d8-42ea-b7e0-f23abfd53c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5be83a-3504-4a43-ab22-de864809d861]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-eee46b8a-7413-45e8-9efc-c4810017a946 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:30 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d7ea20a5-247d-4831-9e2f-578ee661ee3a tempest-VolumeDependencyTests-209927039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-88f8f594-eee6-4c2f-b132-2ccf0bf45828" returned: 0 in 0.747s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d7ea20a5-247d-4831-9e2f-578ee661ee3a tempest-VolumeDependencyTests-209927039 None] Lock "cinder-quobyte-88f8f594-eee6-4c2f-b132-2ccf0bf45828" released by "delete_volume" :: held 1.692s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:30 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:30 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73 Jul 07 17:42:30 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f37c39f-8114-4692-a135-0ac50629bb00" returned: 0 in 0.774s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.849s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7378197-aab3-4206-b108-4190a0a8dd07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45bf3f79ff534ad5914dd99b0c8f86cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:23Z,use_quota=True,user_id='47b973606d924f4e894823e6573f4e28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Creating volume d7378197-aab3-4206-b108-4190a0a8dd07 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:30 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:30 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07 1073741824 Jul 07 17:42:30 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc267fa-c8be-4286-9837-90bb767e02f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f37c39f-8114-4692-a135-0ac50629bb00', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8eeb0a-1d94-4797-bd1b-08761060f692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:30 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Volume volume-4f37c39f-8114-4692-a135-0ac50629bb00 (4f37c39f-8114-4692-a135-0ac50629bb00): created successfully Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8eeb0a-1d94-4797-bd1b-08761060f692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Flow 'volume_create_manager' (d605be27-f3df-4895-aebe-013fddf0b1f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:30 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-d7ea20a5-247d-4831-9e2f-578ee661ee3a tempest-VolumeDependencyTests-209927039 None] Created reservations ['ddcfa1b8-79ef-4b4e-a0ba-12a4c960f1f5', '8eb687d2-7421-41e1-a67a-9014dff04d82', '8fe65ce3-12cd-45b7-a641-da3f47434ea1', 'ea8d0cc6-6f8a-4a32-886b-c377fb10d22e'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:30 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b85c0382-86c4-4c55-a358-7b70decfa32d tempest-ProjectReaderTests-1334318987 None] Created volume successfully. Jul 07 17:42:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d7ea20a5-247d-4831-9e2f-578ee661ee3a tempest-VolumeDependencyTests-209927039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d7ea20a5-247d-4831-9e2f-578ee661ee3a tempest-VolumeDependencyTests-209927039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d7ea20a5-247d-4831-9e2f-578ee661ee3a tempest-VolumeDependencyTests-209927039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d7ea20a5-247d-4831-9e2f-578ee661ee3a tempest-VolumeDependencyTests-209927039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d7ea20a5-247d-4831-9e2f-578ee661ee3a tempest-VolumeDependencyTests-209927039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d7ea20a5-247d-4831-9e2f-578ee661ee3a tempest-VolumeDependencyTests-209927039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:31 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:42:31 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-97df22f7-7f27-42c8-9afa-adf3bdcec0e9 tempest-VolumeDependencyTests-209927039 None] Acquiring lock "cinder-8b1ceafa-213b-4926-9c45-22c5847466a7-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-97df22f7-7f27-42c8-9afa-adf3bdcec0e9 tempest-VolumeDependencyTests-209927039 None] Lock "cinder-8b1ceafa-213b-4926-9c45-22c5847466a7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-97df22f7-7f27-42c8-9afa-adf3bdcec0e9 tempest-VolumeDependencyTests-209927039 None] Acquiring lock "cinder-quobyte-8b1ceafa-213b-4926-9c45-22c5847466a7" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-97df22f7-7f27-42c8-9afa-adf3bdcec0e9 tempest-VolumeDependencyTests-209927039 None] Lock "cinder-quobyte-8b1ceafa-213b-4926-9c45-22c5847466a7" acquired by "delete_volume" :: waited 0.034s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:31 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[618066d9-781a-465b-bd8c-9a2ad2b50670]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-97df22f7-7f27-42c8-9afa-adf3bdcec0e9 tempest-VolumeDependencyTests-209927039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8b1ceafa-213b-4926-9c45-22c5847466a7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:31 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8b1ceafa-213b-4926-9c45-22c5847466a7 Jul 07 17:42:31 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:31 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-eee46b8a-7413-45e8-9efc-c4810017a946 tempest-ProjectReaderTests-1690191251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73" returned: 0 in 0.992s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-eee46b8a-7413-45e8-9efc-c4810017a946 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.a041a8b2-3930-4ce2-8a8f-207b48fe3bc6 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:31 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.a041a8b2-3930-4ce2-8a8f-207b48fe3bc6 Jul 07 17:42:31 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:31 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7db43a51-b824-490f-a29a-817e99a6b9e0 tempest-ProjectReaderTests-1334318987 None] Acquiring lock "cinder-4f37c39f-8114-4692-a135-0ac50629bb00-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:32 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7db43a51-b824-490f-a29a-817e99a6b9e0 tempest-ProjectReaderTests-1334318987 None] Lock "cinder-4f37c39f-8114-4692-a135-0ac50629bb00-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:32 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7db43a51-b824-490f-a29a-817e99a6b9e0 tempest-ProjectReaderTests-1334318987 None] Acquiring lock "cinder-quobyte-4f37c39f-8114-4692-a135-0ac50629bb00" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:32 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7db43a51-b824-490f-a29a-817e99a6b9e0 tempest-ProjectReaderTests-1334318987 None] Lock "cinder-quobyte-4f37c39f-8114-4692-a135-0ac50629bb00" acquired by "delete_volume" :: waited 0.020s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:32 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:32 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[474dd636-301c-4073-82b0-f619a11d90de]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7db43a51-b824-490f-a29a-817e99a6b9e0 tempest-ProjectReaderTests-1334318987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f37c39f-8114-4692-a135-0ac50629bb00 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07 1073741824" returned: 0 in 1.254s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:32 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d7ea20a5-247d-4831-9e2f-578ee661ee3a tempest-VolumeDependencyTests-209927039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.137s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:32 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-d7ea20a5-247d-4831-9e2f-578ee661ee3a tempest-VolumeDependencyTests-209927039 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:32 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-d7ea20a5-247d-4831-9e2f-578ee661ee3a tempest-VolumeDependencyTests-209927039 None] Deleted volume successfully. Jul 07 17:42:32 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07 Jul 07 17:42:32 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:32 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d7ea20a5-247d-4831-9e2f-578ee661ee3a tempest-VolumeDependencyTests-209927039 None] Lock "cinder-88f8f594-eee6-4c2f-b132-2ccf0bf45828-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:32 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f37c39f-8114-4692-a135-0ac50629bb00 Jul 07 17:42:32 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:32 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-97df22f7-7f27-42c8-9afa-adf3bdcec0e9 tempest-VolumeDependencyTests-209927039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8b1ceafa-213b-4926-9c45-22c5847466a7" returned: 0 in 1.154s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-97df22f7-7f27-42c8-9afa-adf3bdcec0e9 tempest-VolumeDependencyTests-209927039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8b1ceafa-213b-4926-9c45-22c5847466a7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:32 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8b1ceafa-213b-4926-9c45-22c5847466a7 Jul 07 17:42:32 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:32 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-eee46b8a-7413-45e8-9efc-c4810017a946 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.a041a8b2-3930-4ce2-8a8f-207b48fe3bc6" returned: 0 in 1.008s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-eee46b8a-7413-45e8-9efc-c4810017a946 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.a041a8b2-3930-4ce2-8a8f-207b48fe3bc6 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:32 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.a041a8b2-3930-4ce2-8a8f-207b48fe3bc6 Jul 07 17:42:32 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:32 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07" returned: 0 in 0.798s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] <== create_volume: return (2102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:42:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.105s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:33 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Attempting download of 00a03fd0-33dc-4388-94df-62a806c20697 ((None, [{'url': 'file:///opt/stack/data/glance/images/00a03fd0-33dc-4388-94df-62a806c20697', 'metadata': {}}])) to volume d7378197-aab3-4206-b108-4190a0a8dd07. {{(pid=87303) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:42:33 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d16f9b-0a08-4283-9e9f-386a0e72196d]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00a03fd0-33dc-4388-94df-62a806c20697_mq_3jwe7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:33 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7db43a51-b824-490f-a29a-817e99a6b9e0 tempest-ProjectReaderTests-1334318987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f37c39f-8114-4692-a135-0ac50629bb00" returned: 0 in 1.093s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7db43a51-b824-490f-a29a-817e99a6b9e0 tempest-ProjectReaderTests-1334318987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f37c39f-8114-4692-a135-0ac50629bb00 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:33 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f37c39f-8114-4692-a135-0ac50629bb00 Jul 07 17:42:33 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:33 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00a03fd0-33dc-4388-94df-62a806c20697_mq_3jwe7 Jul 07 17:42:33 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:33 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-97df22f7-7f27-42c8-9afa-adf3bdcec0e9 tempest-VolumeDependencyTests-209927039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8b1ceafa-213b-4926-9c45-22c5847466a7" returned: 0 in 0.854s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:33 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-97df22f7-7f27-42c8-9afa-adf3bdcec0e9 tempest-VolumeDependencyTests-209927039 None] Lock "cinder-quobyte-8b1ceafa-213b-4926-9c45-22c5847466a7" released by "delete_volume" :: held 2.077s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-eee46b8a-7413-45e8-9efc-c4810017a946 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73.a041a8b2-3930-4ce2-8a8f-207b48fe3bc6" returned: 0 in 0.844s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-eee46b8a-7413-45e8-9efc-c4810017a946 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-a041a8b2-3930-4ce2-8a8f-207b48fe3bc6" released by "_delete_snapshot" :: held 3.800s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-eee46b8a-7413-45e8-9efc-c4810017a946 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-27fda020-13d8-42ea-b7e0-f23abfd53c73" released by "delete_snapshot" :: held 3.829s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:33 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-97df22f7-7f27-42c8-9afa-adf3bdcec0e9 tempest-VolumeDependencyTests-209927039 None] Created reservations ['68325df5-0d60-46e7-987d-dee48cb6d85c', 'c24b63dc-e839-4920-bdcd-ac4f8e006e3c', '79c4ebcb-015d-484b-8e35-b115603b9044', 'fe1ae0aa-9a11-43e0-9d0c-27ad02b26a20'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:33 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-eee46b8a-7413-45e8-9efc-c4810017a946 tempest-ProjectReaderTests-1690191251 None] Created reservations ['4b96cdeb-b4c4-4256-88a0-c82294f25a37', '5fb9599d-c9b0-4926-aec4-d3a0729ed049', '05e64ff6-dbf9-47c2-89d1-05b3468608be', 'f76d59e1-c447-4ef2-804f-001205b3030c'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-97df22f7-7f27-42c8-9afa-adf3bdcec0e9 tempest-VolumeDependencyTests-209927039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-97df22f7-7f27-42c8-9afa-adf3bdcec0e9 tempest-VolumeDependencyTests-209927039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:33 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-97df22f7-7f27-42c8-9afa-adf3bdcec0e9 tempest-VolumeDependencyTests-209927039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:33 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-97df22f7-7f27-42c8-9afa-adf3bdcec0e9 tempest-VolumeDependencyTests-209927039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-97df22f7-7f27-42c8-9afa-adf3bdcec0e9 tempest-VolumeDependencyTests-209927039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-97df22f7-7f27-42c8-9afa-adf3bdcec0e9 tempest-VolumeDependencyTests-209927039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:33 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:42:33 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:33 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-eee46b8a-7413-45e8-9efc-c4810017a946 tempest-ProjectReaderTests-1690191251 None] Delete snapshot completed successfully. Jul 07 17:42:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-eee46b8a-7413-45e8-9efc-c4810017a946 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-a041a8b2-3930-4ce2-8a8f-207b48fe3bc6-delete_snapshot" released by "delete_snapshot" :: held 4.094s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:34 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00a03fd0-33dc-4388-94df-62a806c20697_mq_3jwe7" returned: 0 in 0.881s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00a03fd0-33dc-4388-94df-62a806c20697_mq_3jwe7 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:34 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7db43a51-b824-490f-a29a-817e99a6b9e0 tempest-ProjectReaderTests-1334318987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-4f37c39f-8114-4692-a135-0ac50629bb00" returned: 0 in 0.846s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7db43a51-b824-490f-a29a-817e99a6b9e0 tempest-ProjectReaderTests-1334318987 None] Lock "cinder-quobyte-4f37c39f-8114-4692-a135-0ac50629bb00" released by "delete_volume" :: held 2.005s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:34 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00a03fd0-33dc-4388-94df-62a806c20697_mq_3jwe7 Jul 07 17:42:34 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:34 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-7db43a51-b824-490f-a29a-817e99a6b9e0 tempest-ProjectReaderTests-1334318987 None] Created reservations ['3e6cb7cb-6992-4045-8b3f-3f1ea2426615', 'afc980df-b5fd-43a5-b205-772d6a20be02', '6f0b252a-b038-4e84-84d8-bb95c52f2165', 'b6bc3042-131d-431a-86d8-7108b0650785'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-96e31d36-35cd-4fa9-bc49-e15fd8ae2c23 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-27fda020-13d8-42ea-b7e0-f23abfd53c73-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-96e31d36-35cd-4fa9-bc49-e15fd8ae2c23 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-27fda020-13d8-42ea-b7e0-f23abfd53c73-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-96e31d36-35cd-4fa9-bc49-e15fd8ae2c23 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-quobyte-27fda020-13d8-42ea-b7e0-f23abfd53c73" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-96e31d36-35cd-4fa9-bc49-e15fd8ae2c23 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-27fda020-13d8-42ea-b7e0-f23abfd53c73" acquired by "delete_volume" :: waited 0.029s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7db43a51-b824-490f-a29a-817e99a6b9e0 tempest-ProjectReaderTests-1334318987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7db43a51-b824-490f-a29a-817e99a6b9e0 tempest-ProjectReaderTests-1334318987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7db43a51-b824-490f-a29a-817e99a6b9e0 tempest-ProjectReaderTests-1334318987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:34 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7db43a51-b824-490f-a29a-817e99a6b9e0 tempest-ProjectReaderTests-1334318987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7db43a51-b824-490f-a29a-817e99a6b9e0 tempest-ProjectReaderTests-1334318987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7db43a51-b824-490f-a29a-817e99a6b9e0 tempest-ProjectReaderTests-1334318987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:34 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a21085-45e3-44cb-8086-b5a45ca5cc97]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-96e31d36-35cd-4fa9-bc49-e15fd8ae2c23 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:34 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:42:34 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:34 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73 Jul 07 17:42:34 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:34 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-97df22f7-7f27-42c8-9afa-adf3bdcec0e9 tempest-VolumeDependencyTests-209927039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.942s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:34 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-97df22f7-7f27-42c8-9afa-adf3bdcec0e9 tempest-VolumeDependencyTests-209927039 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:34 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-97df22f7-7f27-42c8-9afa-adf3bdcec0e9 tempest-VolumeDependencyTests-209927039 None] Deleted volume successfully. Jul 07 17:42:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-97df22f7-7f27-42c8-9afa-adf3bdcec0e9 tempest-VolumeDependencyTests-209927039 None] Lock "cinder-8b1ceafa-213b-4926-9c45-22c5847466a7-delete_volume" released by "delete_volume" :: held 3.422s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:35 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00a03fd0-33dc-4388-94df-62a806c20697_mq_3jwe7" returned: 1 in 1.069s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00a03fd0-33dc-4388-94df-62a806c20697_mq_3jwe7' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:42:35 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b359ec-df16-4013-8388-5bcc252a27f6]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:35 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7db43a51-b824-490f-a29a-817e99a6b9e0 tempest-ProjectReaderTests-1334318987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.844s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:35 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-7db43a51-b824-490f-a29a-817e99a6b9e0 tempest-ProjectReaderTests-1334318987 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:35 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-7db43a51-b824-490f-a29a-817e99a6b9e0 tempest-ProjectReaderTests-1334318987 None] Deleted volume successfully. Jul 07 17:42:35 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD Jul 07 17:42:35 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7db43a51-b824-490f-a29a-817e99a6b9e0 tempest-ProjectReaderTests-1334318987 None] Lock "cinder-4f37c39f-8114-4692-a135-0ac50629bb00-delete_volume" released by "delete_volume" :: held 3.338s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:35 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-96e31d36-35cd-4fa9-bc49-e15fd8ae2c23 tempest-ProjectReaderTests-1690191251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73" returned: 0 in 1.062s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-96e31d36-35cd-4fa9-bc49-e15fd8ae2c23 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:35 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73 Jul 07 17:42:35 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Flow 'volume_create_manager' (130d6291-38c4-42bc-b876-55ca7c64c112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b813c4-0145-4ac1-8e7e-79f6f5b96a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:36 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b813c4-0145-4ac1-8e7e-79f6f5b96a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2093258130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da45562c-4216-4ff8-afef-a1b10db068b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09c3d033da24c16bbcaed97af3e5e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:36Z,use_quota=True,user_id='b7bc2b5958a04f199734c1be8706af05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52107f6d-fc74-4129-8fb8-d7415c507f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52107f6d-fc74-4129-8fb8-d7415c507f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f887eac-129c-49b6-ac37-b97cdce50c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f887eac-129c-49b6-ac37-b97cdce50c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da45562c-4216-4ff8-afef-a1b10db068b8', 'volume_name': 'volume-da45562c-4216-4ff8-afef-a1b10db068b8', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6027cb-b629-4c0e-8de9-89859f68cef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6027cb-b629-4c0e-8de9-89859f68cef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a158caf-3a86-4021-857e-6c82868beebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:36 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Volume da45562c-4216-4ff8-afef-a1b10db068b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da45562c-4216-4ff8-afef-a1b10db068b8', 'volume_size': 1} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2093258130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da45562c-4216-4ff8-afef-a1b10db068b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09c3d033da24c16bbcaed97af3e5e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:36Z,use_quota=True,user_id='b7bc2b5958a04f199734c1be8706af05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Creating volume da45562c-4216-4ff8-afef-a1b10db068b8 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:36 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da45562c-4216-4ff8-afef-a1b10db068b8 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD" returned: 0 in 1.092s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:36 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da45562c-4216-4ff8-afef-a1b10db068b8 1073741824 Jul 07 17:42:36 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:36 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD Jul 07 17:42:36 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:36 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-96e31d36-35cd-4fa9-bc49-e15fd8ae2c23 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-27fda020-13d8-42ea-b7e0-f23abfd53c73" returned: 0 in 1.047s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-96e31d36-35cd-4fa9-bc49-e15fd8ae2c23 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-27fda020-13d8-42ea-b7e0-f23abfd53c73" released by "delete_volume" :: held 2.225s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-96e31d36-35cd-4fa9-bc49-e15fd8ae2c23 tempest-ProjectReaderTests-1690191251 None] Created reservations ['301a07e1-9851-4d72-9a36-a408d943e022', 'fadd14b9-5338-458c-a70a-b74a572133db', '3f848f32-5fc1-4f82-8434-e39ac04ee01d', 'e1e21da8-2da2-49d3-83e6-53cc373c3955'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-96e31d36-35cd-4fa9-bc49-e15fd8ae2c23 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-96e31d36-35cd-4fa9-bc49-e15fd8ae2c23 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-96e31d36-35cd-4fa9-bc49-e15fd8ae2c23 tempest-ProjectReaderTests-1690191251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-96e31d36-35cd-4fa9-bc49-e15fd8ae2c23 tempest-ProjectReaderTests-1690191251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-96e31d36-35cd-4fa9-bc49-e15fd8ae2c23 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-96e31d36-35cd-4fa9-bc49-e15fd8ae2c23 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:36 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:42:36 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:37 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD" returned: 1 in 0.983s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:42:37 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] 00a03fd0-33dc-4388-94df-62a806c20697 was raw, converting to raw {{(pid=87303) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:42:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:37 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07 Jul 07 17:42:37 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:37 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da45562c-4216-4ff8-afef-a1b10db068b8 1073741824" returned: 0 in 1.195s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da45562c-4216-4ff8-afef-a1b10db068b8 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:37 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da45562c-4216-4ff8-afef-a1b10db068b8 Jul 07 17:42:37 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:37 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-96e31d36-35cd-4fa9-bc49-e15fd8ae2c23 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.912s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:37 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-96e31d36-35cd-4fa9-bc49-e15fd8ae2c23 tempest-ProjectReaderTests-1690191251 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:37 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-96e31d36-35cd-4fa9-bc49-e15fd8ae2c23 tempest-ProjectReaderTests-1690191251 None] Deleted volume successfully. Jul 07 17:42:37 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-96e31d36-35cd-4fa9-bc49-e15fd8ae2c23 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-27fda020-13d8-42ea-b7e0-f23abfd53c73-delete_volume" released by "delete_volume" :: held 3.491s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:38 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da45562c-4216-4ff8-afef-a1b10db068b8" returned: 0 in 0.906s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] <== create_volume: return (2180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.186s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:38 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Flow 'volume_create_manager' (b99d86f2-a520-48a5-b132-825316e158c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de496e6c-0a3f-4c9c-9775-1e50a42b4ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a158caf-3a86-4021-857e-6c82868beebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da45562c-4216-4ff8-afef-a1b10db068b8', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9237c7b3-44f3-47e1-9968-6cf495f32e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07" returned: 0 in 1.247s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_00a03fd0-33dc-4388-94df-62a806c20697_iybdr3i0devstack@QuobyteHD, size 0.00 MB, duration 1.25 sec, destination /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07 {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:42:38 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de496e6c-0a3f-4c9c-9775-1e50a42b4ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-235701537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20eb4461-ddd6-441c-ae75-15b6b4e52bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ac77c0e4184ec79759fdc2759452f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:38Z,use_quota=True,user_id='432b342bf7cf42968fe570ca1f4ae255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23230763-1a7f-411d-ad06-2b36cf80e78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23230763-1a7f-411d-ad06-2b36cf80e78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:38 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07 1G Jul 07 17:42:38 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a9850e3-1d7f-4ec8-848d-4881d59d8758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a9850e3-1d7f-4ec8-848d-4881d59d8758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20eb4461-ddd6-441c-ae75-15b6b4e52bcb', 'volume_name': 'volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5038d20-3caa-46ed-bb3d-faa3cf699bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5038d20-3caa-46ed-bb3d-faa3cf699bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e73655c-1372-49db-8c13-fe43aea51675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:38 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Volume 20eb4461-ddd6-441c-ae75-15b6b4e52bcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb', 'volume_size': 1} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-235701537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20eb4461-ddd6-441c-ae75-15b6b4e52bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ac77c0e4184ec79759fdc2759452f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:38Z,use_quota=True,user_id='432b342bf7cf42968fe570ca1f4ae255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Creating volume 20eb4461-ddd6-441c-ae75-15b6b4e52bcb {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:38 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:38 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Volume volume-da45562c-4216-4ff8-afef-a1b10db068b8 (da45562c-4216-4ff8-afef-a1b10db068b8): created successfully Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9237c7b3-44f3-47e1-9968-6cf495f32e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:38 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb 1073741824 Jul 07 17:42:38 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:38 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Flow 'volume_create_manager' (130d6291-38c4-42bc-b876-55ca7c64c112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:38 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-242b1e39-de85-4cd0-abd8-2e42117bcb0d tempest-ProjectReaderTests-1334318987 None] Created volume successfully. Jul 07 17:42:39 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Flow 'volume_create_manager' (36d97429-acf1-4557-8bf7-0521155e8317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46842045-00fe-4274-b93a-615578f4542f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46842045-00fe-4274-b93a-615578f4542f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7bc7af6-7837-42cc-83f1-20bcb2127412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d4d0fa0dbb4d8da9171298fbd1907a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:39Z,use_quota=True,user_id='3e41abdd06de43eca8f909a704309a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc497f90-0326-4c01-b33d-bcbcc468a233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc497f90-0326-4c01-b33d-bcbcc468a233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c43626-6249-49b7-b0f3-0cfb29cc40b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c43626-6249-49b7-b0f3-0cfb29cc40b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7bc7af6-7837-42cc-83f1-20bcb2127412', 'volume_name': 'volume-c7bc7af6-7837-42cc-83f1-20bcb2127412', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f761c16e-2ebd-4f99-b622-167cec9763fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f761c16e-2ebd-4f99-b622-167cec9763fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:39 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6ebd98-46cf-44cc-8025-c87211bd0093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:39 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Volume c7bc7af6-7837-42cc-83f1-20bcb2127412: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7bc7af6-7837-42cc-83f1-20bcb2127412', 'volume_size': 1} Jul 07 17:42:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:39 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-168b7680-d632-4438-aa3a-f24f883fb93e tempest-ProjectReaderTests-1334318987 None] Acquiring lock "cinder-da45562c-4216-4ff8-afef-a1b10db068b8-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:39 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-168b7680-d632-4438-aa3a-f24f883fb93e tempest-ProjectReaderTests-1334318987 None] Lock "cinder-da45562c-4216-4ff8-afef-a1b10db068b8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:39 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-168b7680-d632-4438-aa3a-f24f883fb93e tempest-ProjectReaderTests-1334318987 None] Acquiring lock "cinder-quobyte-da45562c-4216-4ff8-afef-a1b10db068b8" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:39 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-168b7680-d632-4438-aa3a-f24f883fb93e tempest-ProjectReaderTests-1334318987 None] Lock "cinder-quobyte-da45562c-4216-4ff8-afef-a1b10db068b8" acquired by "delete_volume" :: waited 0.026s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:39 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07 1G" returned: 0 in 0.969s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:39 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[bece1d92-edb4-4c68-92f6-e8f4ceadc930]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-168b7680-d632-4438-aa3a-f24f883fb93e tempest-ProjectReaderTests-1334318987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da45562c-4216-4ff8-afef-a1b10db068b8 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:39 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[57266195-599b-4aa8-b7af-24cf66fe303f]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:39 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da45562c-4216-4ff8-afef-a1b10db068b8 Jul 07 17:42:39 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:39 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07 Jul 07 17:42:39 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:39 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb 1073741824" returned: 0 in 1.128s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:39 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb Jul 07 17:42:39 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:40 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07" returned: 0 in 0.820s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:40 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-168b7680-d632-4438-aa3a-f24f883fb93e tempest-ProjectReaderTests-1334318987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da45562c-4216-4ff8-afef-a1b10db068b8" returned: 0 in 0.885s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-168b7680-d632-4438-aa3a-f24f883fb93e tempest-ProjectReaderTests-1334318987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da45562c-4216-4ff8-afef-a1b10db068b8 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:40 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da45562c-4216-4ff8-afef-a1b10db068b8 Jul 07 17:42:40 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:40 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07 Jul 07 17:42:40 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:40 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb" returned: 0 in 0.803s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:40 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] <== create_volume: return (1989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:42:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.363s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:40 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7bc7af6-7837-42cc-83f1-20bcb2127412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d4d0fa0dbb4d8da9171298fbd1907a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:39Z,use_quota=True,user_id='3e41abdd06de43eca8f909a704309a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:42:40 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Creating volume c7bc7af6-7837-42cc-83f1-20bcb2127412 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:42:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:40 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:40 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:40 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:40 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:42:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c7bc7af6-7837-42cc-83f1-20bcb2127412 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:40 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c7bc7af6-7837-42cc-83f1-20bcb2127412 1073741824 Jul 07 17:42:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e73655c-1372-49db-8c13-fe43aea51675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:40 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4573cb70-6201-4c27-9ddb-e621863f3e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:40 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Volume volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb (20eb4461-ddd6-441c-ae75-15b6b4e52bcb): created successfully Jul 07 17:42:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4573cb70-6201-4c27-9ddb-e621863f3e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:40 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Flow 'volume_create_manager' (b99d86f2-a520-48a5-b132-825316e158c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:40 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-9468b2ca-6788-4a8b-9bd2-c64428870ed0 tempest-ProjectReaderTests-1690191251 None] Created volume successfully. Jul 07 17:42:41 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-168b7680-d632-4438-aa3a-f24f883fb93e tempest-ProjectReaderTests-1334318987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-da45562c-4216-4ff8-afef-a1b10db068b8" returned: 0 in 0.815s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-168b7680-d632-4438-aa3a-f24f883fb93e tempest-ProjectReaderTests-1334318987 None] Lock "cinder-quobyte-da45562c-4216-4ff8-afef-a1b10db068b8" released by "delete_volume" :: held 1.756s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:41 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07" returned: 1 in 0.889s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Downloaded image 00a03fd0-33dc-4388-94df-62a806c20697 ((None, [{'url': 'file:///opt/stack/data/glance/images/00a03fd0-33dc-4388-94df-62a806c20697', 'metadata': {}}])) to volume d7378197-aab3-4206-b108-4190a0a8dd07 successfully. {{(pid=87303) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Temporary image 00a03fd0-33dc-4388-94df-62a806c20697 for user 47b973606d924f4e894823e6573f4e28 is deleted. {{(pid=87303) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG cinder.volume.volume_utils [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Marking volume d7378197-aab3-4206-b108-4190a0a8dd07 as bootable. {{(pid=87303) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Copying metadata from image 00a03fd0-33dc-4388-94df-62a806c20697 to d7378197-aab3-4206-b108-4190a0a8dd07. {{(pid=87303) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Creating volume glance metadata for volume d7378197-aab3-4206-b108-4190a0a8dd07 backed by image 00a03fd0-33dc-4388-94df-62a806c20697 with: {'image_id': '00a03fd0-33dc-4388-94df-62a806c20697', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6acd9183d3b05f58eb7be7e0e4a01423', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87303) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-168b7680-d632-4438-aa3a-f24f883fb93e tempest-ProjectReaderTests-1334318987 None] Created reservations ['f7090292-383a-4eb1-a2f7-2ca33cf68804', '88117004-09be-4135-80f5-b35b93171eb2', 'f53b096b-9558-4e0e-925c-f9a360c8ef97', '1726c620-2fb1-49a9-9d53-eda98837a45c'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-168b7680-d632-4438-aa3a-f24f883fb93e tempest-ProjectReaderTests-1334318987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-168b7680-d632-4438-aa3a-f24f883fb93e tempest-ProjectReaderTests-1334318987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-168b7680-d632-4438-aa3a-f24f883fb93e tempest-ProjectReaderTests-1334318987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-168b7680-d632-4438-aa3a-f24f883fb93e tempest-ProjectReaderTests-1334318987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-168b7680-d632-4438-aa3a-f24f883fb93e tempest-ProjectReaderTests-1334318987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-168b7680-d632-4438-aa3a-f24f883fb93e tempest-ProjectReaderTests-1334318987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6f2c1e1-de84-488e-aec4-35f55ca50906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7378197-aab3-4206-b108-4190a0a8dd07', 'volume_size': 1, 'image_id': '00a03fd0-33dc-4388-94df-62a806c20697', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00a03fd0-33dc-4388-94df-62a806c20697', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6acd9183d3b05f58eb7be7e0e4a01423', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '45bf3f79ff534ad5914dd99b0c8f86cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7d4de67489d3499cb407c76e0636f6920dcd7e54454318e8418515c1b7790557d783d59b089e48c5c5fabcf031a3c3a40396810d06fb68daab2812ff96b2d299', 'id': '00a03fd0-33dc-4388-94df-62a806c20697', 'created_at': datetime.datetime(2026, 7, 7, 15, 42, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 42, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00a03fd0-33dc-4388-94df-62a806c20697/file', 'properties': {}}, 'image_service': }' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:41 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:42:41 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d7b33b-2c8c-44cb-86e8-81d6dbb735e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:41 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Volume volume-d7378197-aab3-4206-b108-4190a0a8dd07 (d7378197-aab3-4206-b108-4190a0a8dd07): created successfully Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d7b33b-2c8c-44cb-86e8-81d6dbb735e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Flow 'volume_create_manager' (c4f83db1-df8a-4a18-bfd3-6f841525544a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:41 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b7f789b2-ef5c-4b97-85b6-fb43b1e751d6 tempest-VolumeImageDependencyTests-671422011 None] Created volume successfully. Jul 07 17:42:41 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c7bc7af6-7837-42cc-83f1-20bcb2127412 1073741824" returned: 0 in 1.000s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c7bc7af6-7837-42cc-83f1-20bcb2127412 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:41 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c7bc7af6-7837-42cc-83f1-20bcb2127412 Jul 07 17:42:41 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6e965deb-2f98-401b-8f2c-207dcf365559 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-70c04b95-a10b-458f-9e70-788a06d020ed tempest-VolumeImageDependencyTests-671422011 None] Acquiring lock "cinder-d7378197-aab3-4206-b108-4190a0a8dd07-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:41 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-70c04b95-a10b-458f-9e70-788a06d020ed tempest-VolumeImageDependencyTests-671422011 None] Lock "cinder-d7378197-aab3-4206-b108-4190a0a8dd07-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-70c04b95-a10b-458f-9e70-788a06d020ed tempest-VolumeImageDependencyTests-671422011 None] Acquiring lock "cinder-quobyte-d7378197-aab3-4206-b108-4190a0a8dd07" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-70c04b95-a10b-458f-9e70-788a06d020ed tempest-VolumeImageDependencyTests-671422011 None] Lock "cinder-quobyte-d7378197-aab3-4206-b108-4190a0a8dd07" acquired by "delete_volume" :: waited 0.031s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b63a798-9eab-4b59-996b-4206dad9484a]: (4, 'raw') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-70c04b95-a10b-458f-9e70-788a06d020ed tempest-VolumeImageDependencyTests-671422011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:42 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07 Jul 07 17:42:42 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Flow 'volume_create_manager' (ae7f6ec3-39a6-42b3-af82-4450f94c9364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097b43bc-c588-42ea-b6a9-372659c6aafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:42 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097b43bc-c588-42ea-b6a9-372659c6aafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1447626909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f312270-146c-4bdb-ade9-7ccdaff792fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09c3d033da24c16bbcaed97af3e5e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:42Z,use_quota=True,user_id='b7bc2b5958a04f199734c1be8706af05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac69fc0-b424-4aa8-8971-5d7de54954c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac69fc0-b424-4aa8-8971-5d7de54954c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e864cbd5-0e84-48a3-a35a-00515ce67e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e864cbd5-0e84-48a3-a35a-00515ce67e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f312270-146c-4bdb-ade9-7ccdaff792fa', 'volume_name': 'volume-8f312270-146c-4bdb-ade9-7ccdaff792fa', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7251c755-d64d-46ea-b63a-0423f94c1067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7251c755-d64d-46ea-b63a-0423f94c1067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:42 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62495b27-65b2-4ddf-866a-4980cf0186a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:42 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Volume 8f312270-146c-4bdb-ade9-7ccdaff792fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f312270-146c-4bdb-ade9-7ccdaff792fa', 'volume_size': 1} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c7bc7af6-7837-42cc-83f1-20bcb2127412" returned: 0 in 0.892s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-168b7680-d632-4438-aa3a-f24f883fb93e tempest-ProjectReaderTests-1334318987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.119s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.956s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-168b7680-d632-4438-aa3a-f24f883fb93e tempest-ProjectReaderTests-1334318987 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6e965deb-2f98-401b-8f2c-207dcf365559 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.689s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:42 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-168b7680-d632-4438-aa3a-f24f883fb93e tempest-ProjectReaderTests-1334318987 None] Deleted volume successfully. Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6ebd98-46cf-44cc-8025-c87211bd0093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7bc7af6-7837-42cc-83f1-20bcb2127412', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7914083e-c96a-4010-bab6-8cd974430c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-6e965deb-2f98-401b-8f2c-207dcf365559 tempest-ProjectReaderTests-1690191251 None] Creating offline snapshot a6be0754-cb76-45a0-83b3-a249e1b705a5 of volume 20eb4461-ddd6-441c-ae75-15b6b4e52bcb {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:42:42 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Volume volume-c7bc7af6-7837-42cc-83f1-20bcb2127412 (c7bc7af6-7837-42cc-83f1-20bcb2127412): created successfully Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7914083e-c96a-4010-bab6-8cd974430c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Flow 'volume_create_manager' (36d97429-acf1-4557-8bf7-0521155e8317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1df1e4-9743-4616-937f-f29696dfb8a1]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6e965deb-2f98-401b-8f2c-207dcf365559 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:42 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-168b7680-d632-4438-aa3a-f24f883fb93e tempest-ProjectReaderTests-1334318987 None] Lock "cinder-da45562c-4216-4ff8-afef-a1b10db068b8-delete_volume" released by "delete_volume" :: held 3.245s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:42 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-7e39754d-6442-4f1b-b0ac-1ef675da9424 tempest-CinderUnicodeTest-1025874071 None] Created volume successfully. Jul 07 17:42:42 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb Jul 07 17:42:42 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:43 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-70c04b95-a10b-458f-9e70-788a06d020ed tempest-VolumeImageDependencyTests-671422011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07" returned: 0 in 0.873s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-70c04b95-a10b-458f-9e70-788a06d020ed tempest-VolumeImageDependencyTests-671422011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:43 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07 Jul 07 17:42:43 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:43 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6e965deb-2f98-401b-8f2c-207dcf365559 tempest-ProjectReaderTests-1690191251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb" returned: 0 in 0.870s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6e965deb-2f98-401b-8f2c-207dcf365559 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.a6be0754-cb76-45a0-83b3-a249e1b705a5 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:43 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.a6be0754-cb76-45a0-83b3-a249e1b705a5 1G Jul 07 17:42:43 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:43 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Flow 'volume_create_manager' (63ee8931-a304-4229-a6df-b5f84e81701d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff04c4a-cf3a-49be-af58-d96961de870b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff04c4a-cf3a-49be-af58-d96961de870b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-672772808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d72ea3b-610f-4667-9e3a-73de0da55b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d4d0fa0dbb4d8da9171298fbd1907a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:44Z,use_quota=True,user_id='3e41abdd06de43eca8f909a704309a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d761639e-d749-4518-b659-28e5d3394801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d761639e-d749-4518-b659-28e5d3394801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:43 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26670cc-a3a6-49a0-8da3-d28f5d51ad6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26670cc-a3a6-49a0-8da3-d28f5d51ad6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d72ea3b-610f-4667-9e3a-73de0da55b64', 'volume_name': 'volume-6d72ea3b-610f-4667-9e3a-73de0da55b64', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c8004a-a72d-4d44-b302-3c23b9235ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c8004a-a72d-4d44-b302-3c23b9235ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:43 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecbdebd0-c636-4541-8cd5-c364accbe1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:43 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Volume 6d72ea3b-610f-4667-9e3a-73de0da55b64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d72ea3b-610f-4667-9e3a-73de0da55b64', 'volume_size': 1} Jul 07 17:42:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-70c04b95-a10b-458f-9e70-788a06d020ed tempest-VolumeImageDependencyTests-671422011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07" returned: 1 in 0.940s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-70c04b95-a10b-458f-9e70-788a06d020ed tempest-VolumeImageDependencyTests-671422011 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07' failed. Not Retrying. {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:42:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-70c04b95-a10b-458f-9e70-788a06d020ed tempest-VolumeImageDependencyTests-671422011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:44 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07 Jul 07 17:42:44 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:44 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6e965deb-2f98-401b-8f2c-207dcf365559 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.a6be0754-cb76-45a0-83b3-a249e1b705a5 1G" returned: 0 in 0.938s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6e965deb-2f98-401b-8f2c-207dcf365559 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.a6be0754-cb76-45a0-83b3-a249e1b705a5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:44 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.a6be0754-cb76-45a0-83b3-a249e1b705a5 Jul 07 17:42:44 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:44 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-70c04b95-a10b-458f-9e70-788a06d020ed tempest-VolumeImageDependencyTests-671422011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d7378197-aab3-4206-b108-4190a0a8dd07" returned: 0 in 0.810s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:44 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-70c04b95-a10b-458f-9e70-788a06d020ed tempest-VolumeImageDependencyTests-671422011 None] Lock "cinder-quobyte-d7378197-aab3-4206-b108-4190a0a8dd07" released by "delete_volume" :: held 2.745s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:44 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-70c04b95-a10b-458f-9e70-788a06d020ed tempest-VolumeImageDependencyTests-671422011 None] Created reservations ['d3bceb0c-35b2-45c2-bbbe-7511e7d301dd', 'ab0cb68d-5821-4adf-b8a3-7303bc50f54c', 'ec2fd6f6-63e2-4dd7-8130-104f91768afc', '0dd5dc4d-fd87-47e5-8840-0084e43228dc'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-70c04b95-a10b-458f-9e70-788a06d020ed tempest-VolumeImageDependencyTests-671422011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-70c04b95-a10b-458f-9e70-788a06d020ed tempest-VolumeImageDependencyTests-671422011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-70c04b95-a10b-458f-9e70-788a06d020ed tempest-VolumeImageDependencyTests-671422011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-70c04b95-a10b-458f-9e70-788a06d020ed tempest-VolumeImageDependencyTests-671422011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-70c04b95-a10b-458f-9e70-788a06d020ed tempest-VolumeImageDependencyTests-671422011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-70c04b95-a10b-458f-9e70-788a06d020ed tempest-VolumeImageDependencyTests-671422011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:45 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:42:45 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:45 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6e965deb-2f98-401b-8f2c-207dcf365559 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.a6be0754-cb76-45a0-83b3-a249e1b705a5" returned: 0 in 0.782s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:45 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-6e965deb-2f98-401b-8f2c-207dcf365559 tempest-ProjectReaderTests-1690191251 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.a6be0754-cb76-45a0-83b3-a249e1b705a5 is being set with open permissions: ugo+rw Jul 07 17:42:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6e965deb-2f98-401b-8f2c-207dcf365559 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.a6be0754-cb76-45a0-83b3-a249e1b705a5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:45 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.a6be0754-cb76-45a0-83b3-a249e1b705a5 Jul 07 17:42:45 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:45 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-70c04b95-a10b-458f-9e70-788a06d020ed tempest-VolumeImageDependencyTests-671422011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.790s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:45 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-70c04b95-a10b-458f-9e70-788a06d020ed tempest-VolumeImageDependencyTests-671422011 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:45 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-70c04b95-a10b-458f-9e70-788a06d020ed tempest-VolumeImageDependencyTests-671422011 None] Deleted volume successfully. Jul 07 17:42:45 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-70c04b95-a10b-458f-9e70-788a06d020ed tempest-VolumeImageDependencyTests-671422011 None] Lock "cinder-d7378197-aab3-4206-b108-4190a0a8dd07-delete_volume" released by "delete_volume" :: held 3.836s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:45 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6e965deb-2f98-401b-8f2c-207dcf365559 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.a6be0754-cb76-45a0-83b3-a249e1b705a5" returned: 0 in 0.736s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6e965deb-2f98-401b-8f2c-207dcf365559 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:45 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.info Jul 07 17:42:45 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:46 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6e965deb-2f98-401b-8f2c-207dcf365559 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.info" returned: 0 in 0.807s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:46 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-6e965deb-2f98-401b-8f2c-207dcf365559 tempest-ProjectReaderTests-1690191251 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.info is being set with open permissions: ugo+rw Jul 07 17:42:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6e965deb-2f98-401b-8f2c-207dcf365559 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:46 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.info Jul 07 17:42:46 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:47 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6e965deb-2f98-401b-8f2c-207dcf365559 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.info" returned: 0 in 0.767s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6e965deb-2f98-401b-8f2c-207dcf365559 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.035s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.050s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1447626909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f312270-146c-4bdb-ade9-7ccdaff792fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09c3d033da24c16bbcaed97af3e5e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:42Z,use_quota=True,user_id='b7bc2b5958a04f199734c1be8706af05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:42:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Creating volume 8f312270-146c-4bdb-ade9-7ccdaff792fa {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:42:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:47 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:42:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f312270-146c-4bdb-ade9-7ccdaff792fa 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:47 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f312270-146c-4bdb-ade9-7ccdaff792fa 1073741824 Jul 07 17:42:47 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:47 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-6e965deb-2f98-401b-8f2c-207dcf365559 tempest-ProjectReaderTests-1690191251 None] Create snapshot completed successfully Jul 07 17:42:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-38ded4c9-c1b3-4ade-a30a-1b570f42fb12 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-a6be0754-cb76-45a0-83b3-a249e1b705a5-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-38ded4c9-c1b3-4ade-a30a-1b570f42fb12 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-a6be0754-cb76-45a0-83b3-a249e1b705a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-38ded4c9-c1b3-4ade-a30a-1b570f42fb12 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-quobyte-20eb4461-ddd6-441c-ae75-15b6b4e52bcb" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-38ded4c9-c1b3-4ade-a30a-1b570f42fb12 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-20eb4461-ddd6-441c-ae75-15b6b4e52bcb" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-38ded4c9-c1b3-4ade-a30a-1b570f42fb12 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-quobyte-a6be0754-cb76-45a0-83b3-a249e1b705a5" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:48 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-38ded4c9-c1b3-4ade-a30a-1b570f42fb12 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-a6be0754-cb76-45a0-83b3-a249e1b705a5" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-38ded4c9-c1b3-4ade-a30a-1b570f42fb12 tempest-ProjectReaderTests-1690191251 None] Deleting offline snapshot a6be0754-cb76-45a0-83b3-a249e1b705a5 of volume 20eb4461-ddd6-441c-ae75-15b6b4e52bcb {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:42:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-38ded4c9-c1b3-4ade-a30a-1b570f42fb12 tempest-ProjectReaderTests-1690191251 None] snapshot_file for this snap is: volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.a6be0754-cb76-45a0-83b3-a249e1b705a5 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:42:48 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fbeb98-a14f-4ac8-afff-f9c3ea11b599]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38ded4c9-c1b3-4ade-a30a-1b570f42fb12 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.a6be0754-cb76-45a0-83b3-a249e1b705a5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:48 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.a6be0754-cb76-45a0-83b3-a249e1b705a5 Jul 07 17:42:48 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:48 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f312270-146c-4bdb-ade9-7ccdaff792fa 1073741824" returned: 0 in 1.149s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f312270-146c-4bdb-ade9-7ccdaff792fa {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:48 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f312270-146c-4bdb-ade9-7ccdaff792fa Jul 07 17:42:48 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:49 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38ded4c9-c1b3-4ade-a30a-1b570f42fb12 tempest-ProjectReaderTests-1690191251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.a6be0754-cb76-45a0-83b3-a249e1b705a5" returned: 0 in 1.049s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-38ded4c9-c1b3-4ade-a30a-1b570f42fb12 tempest-ProjectReaderTests-1690191251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:42:49 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9b64af-a3d4-41f1-94da-703e5de11a95]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38ded4c9-c1b3-4ade-a30a-1b570f42fb12 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:49 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb Jul 07 17:42:49 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:49 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f312270-146c-4bdb-ade9-7ccdaff792fa" returned: 0 in 0.785s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:42:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.527s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-672772808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d72ea3b-610f-4667-9e3a-73de0da55b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d4d0fa0dbb4d8da9171298fbd1907a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:44Z,use_quota=True,user_id='3e41abdd06de43eca8f909a704309a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:42:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Creating volume 6d72ea3b-610f-4667-9e3a-73de0da55b64 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:42:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:49 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:42:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62495b27-65b2-4ddf-866a-4980cf0186a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f312270-146c-4bdb-ade9-7ccdaff792fa', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b204085d-e483-4e27-a4b7-89bbfc395fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:49 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64 1073741824 Jul 07 17:42:49 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:49 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Volume volume-8f312270-146c-4bdb-ade9-7ccdaff792fa (8f312270-146c-4bdb-ade9-7ccdaff792fa): created successfully Jul 07 17:42:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b204085d-e483-4e27-a4b7-89bbfc395fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Flow 'volume_create_manager' (ae7f6ec3-39a6-42b3-af82-4450f94c9364) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:49 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-6da94099-138d-4f53-817a-9c7e5af8b814 tempest-ProjectReaderTests-1334318987 None] Created volume successfully. Jul 07 17:42:50 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f5a3b160-e935-47a6-966a-4db42db4eecc tempest-ProjectReaderTests-1334318987 None] Acquiring lock "cinder-8f312270-146c-4bdb-ade9-7ccdaff792fa-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:50 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f5a3b160-e935-47a6-966a-4db42db4eecc tempest-ProjectReaderTests-1334318987 None] Lock "cinder-8f312270-146c-4bdb-ade9-7ccdaff792fa-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:50 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Flow 'volume_create_manager' (a8949c0a-f117-4243-86c3-6bda6985869a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1a484e2-665a-450c-b8b4-6c8ae9a2ffb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1a484e2-665a-450c-b8b4-6c8ae9a2ffb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-442498789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0235730b-8f8f-470c-906b-a4c8dad9a985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0b58d71fa140d991a236c4f4eef6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:50Z,use_quota=True,user_id='11c2377e77ba472e95fe61cd6ab8ed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b43e74c-d6bb-4bdb-9515-da8f6520b35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b43e74c-d6bb-4bdb-9515-da8f6520b35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8481d7df-acf5-4f6a-9699-5f8350d811c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8481d7df-acf5-4f6a-9699-5f8350d811c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0235730b-8f8f-470c-906b-a4c8dad9a985', 'volume_name': 'volume-0235730b-8f8f-470c-906b-a4c8dad9a985', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1421183f-e10d-4fb5-ae20-d31466798d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1421183f-e10d-4fb5-ae20-d31466798d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faefa4c6-f551-45bb-88a5-902efc6dcf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:50 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Volume 0235730b-8f8f-470c-906b-a4c8dad9a985: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0235730b-8f8f-470c-906b-a4c8dad9a985', 'volume_size': 1} Jul 07 17:42:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:50 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f5a3b160-e935-47a6-966a-4db42db4eecc tempest-ProjectReaderTests-1334318987 None] Acquiring lock "cinder-quobyte-8f312270-146c-4bdb-ade9-7ccdaff792fa" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:50 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f5a3b160-e935-47a6-966a-4db42db4eecc tempest-ProjectReaderTests-1334318987 None] Lock "cinder-quobyte-8f312270-146c-4bdb-ade9-7ccdaff792fa" acquired by "delete_volume" :: waited 0.031s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:50 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b76e43-6f40-4814-bc2f-e21e80eb3106]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f5a3b160-e935-47a6-966a-4db42db4eecc tempest-ProjectReaderTests-1334318987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f312270-146c-4bdb-ade9-7ccdaff792fa {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:50 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38ded4c9-c1b3-4ade-a30a-1b570f42fb12 tempest-ProjectReaderTests-1690191251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb" returned: 0 in 1.106s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38ded4c9-c1b3-4ade-a30a-1b570f42fb12 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.a6be0754-cb76-45a0-83b3-a249e1b705a5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:50 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.a6be0754-cb76-45a0-83b3-a249e1b705a5 Jul 07 17:42:50 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:50 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f312270-146c-4bdb-ade9-7ccdaff792fa Jul 07 17:42:50 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:50 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64 1073741824" returned: 0 in 1.154s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:50 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64 Jul 07 17:42:50 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:51 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f5a3b160-e935-47a6-966a-4db42db4eecc tempest-ProjectReaderTests-1334318987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f312270-146c-4bdb-ade9-7ccdaff792fa" returned: 0 in 0.919s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f5a3b160-e935-47a6-966a-4db42db4eecc tempest-ProjectReaderTests-1334318987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f312270-146c-4bdb-ade9-7ccdaff792fa {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:51 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f312270-146c-4bdb-ade9-7ccdaff792fa Jul 07 17:42:51 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:51 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38ded4c9-c1b3-4ade-a30a-1b570f42fb12 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.a6be0754-cb76-45a0-83b3-a249e1b705a5" returned: 0 in 0.914s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38ded4c9-c1b3-4ade-a30a-1b570f42fb12 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.a6be0754-cb76-45a0-83b3-a249e1b705a5 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:51 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.a6be0754-cb76-45a0-83b3-a249e1b705a5 Jul 07 17:42:51 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:51 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64" returned: 0 in 0.795s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:42:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.235s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-442498789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0235730b-8f8f-470c-906b-a4c8dad9a985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0b58d71fa140d991a236c4f4eef6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:50Z,use_quota=True,user_id='11c2377e77ba472e95fe61cd6ab8ed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:42:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Creating volume 0235730b-8f8f-470c-906b-a4c8dad9a985 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:42:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:51 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:51 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:42:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:51 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985 1073741824 Jul 07 17:42:51 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:51 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecbdebd0-c636-4541-8cd5-c364accbe1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d72ea3b-610f-4667-9e3a-73de0da55b64', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:51 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3ce0c6-2940-48cd-a55f-761bde3a1c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:51 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Volume volume-6d72ea3b-610f-4667-9e3a-73de0da55b64 (6d72ea3b-610f-4667-9e3a-73de0da55b64): created successfully Jul 07 17:42:51 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3ce0c6-2940-48cd-a55f-761bde3a1c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:51 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Flow 'volume_create_manager' (63ee8931-a304-4229-a6df-b5f84e81701d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:51 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5659dc52-5ab0-467a-be3f-4ef3fa969bd8 tempest-CinderUnicodeTest-1025874071 None] Created volume successfully. Jul 07 17:42:52 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f5a3b160-e935-47a6-966a-4db42db4eecc tempest-ProjectReaderTests-1334318987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-8f312270-146c-4bdb-ade9-7ccdaff792fa" returned: 0 in 0.743s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:52 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f5a3b160-e935-47a6-966a-4db42db4eecc tempest-ProjectReaderTests-1334318987 None] Lock "cinder-quobyte-8f312270-146c-4bdb-ade9-7ccdaff792fa" released by "delete_volume" :: held 1.727s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:52 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-f5a3b160-e935-47a6-966a-4db42db4eecc tempest-ProjectReaderTests-1334318987 None] Created reservations ['8fcfe0e6-fd50-44f8-b1d1-0e670dbc7266', '122d44f9-d6aa-4f3e-a7a4-1845791a6fc4', 'cdb1a757-3580-4798-b830-241ea0738ace', 'd5e94224-56ad-4636-9a69-562de9a98f40'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:52 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-38ded4c9-c1b3-4ade-a30a-1b570f42fb12 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb.a6be0754-cb76-45a0-83b3-a249e1b705a5" returned: 0 in 0.769s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:52 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-38ded4c9-c1b3-4ade-a30a-1b570f42fb12 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-a6be0754-cb76-45a0-83b3-a249e1b705a5" released by "_delete_snapshot" :: held 3.995s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:52 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-38ded4c9-c1b3-4ade-a30a-1b570f42fb12 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-20eb4461-ddd6-441c-ae75-15b6b4e52bcb" released by "delete_snapshot" :: held 4.033s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f5a3b160-e935-47a6-966a-4db42db4eecc tempest-ProjectReaderTests-1334318987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f5a3b160-e935-47a6-966a-4db42db4eecc tempest-ProjectReaderTests-1334318987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:52 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f5a3b160-e935-47a6-966a-4db42db4eecc tempest-ProjectReaderTests-1334318987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:52 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f5a3b160-e935-47a6-966a-4db42db4eecc tempest-ProjectReaderTests-1334318987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f5a3b160-e935-47a6-966a-4db42db4eecc tempest-ProjectReaderTests-1334318987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f5a3b160-e935-47a6-966a-4db42db4eecc tempest-ProjectReaderTests-1334318987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:52 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:42:52 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:52 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-38ded4c9-c1b3-4ade-a30a-1b570f42fb12 tempest-ProjectReaderTests-1690191251 None] Created reservations ['69a0a567-a9d5-49b3-8bc9-3bceebc07982', '91a0cdc2-768f-4ac7-8558-ff50742c9d83', 'bdefa98d-6175-4307-8088-06e1d5009434', 'b83f741d-d3a4-4391-97ce-c3e2f0ca4f6a'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:52 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-38ded4c9-c1b3-4ade-a30a-1b570f42fb12 tempest-ProjectReaderTests-1690191251 None] Delete snapshot completed successfully. Jul 07 17:42:52 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-38ded4c9-c1b3-4ade-a30a-1b570f42fb12 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-a6be0754-cb76-45a0-83b3-a249e1b705a5-delete_snapshot" released by "delete_snapshot" :: held 4.310s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:52 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-87bf5f1f-4c27-4941-a3a7-a6ccbfe14205 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-20eb4461-ddd6-441c-ae75-15b6b4e52bcb-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:52 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-87bf5f1f-4c27-4941-a3a7-a6ccbfe14205 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-20eb4461-ddd6-441c-ae75-15b6b4e52bcb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:52 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-87bf5f1f-4c27-4941-a3a7-a6ccbfe14205 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-quobyte-20eb4461-ddd6-441c-ae75-15b6b4e52bcb" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:52 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-87bf5f1f-4c27-4941-a3a7-a6ccbfe14205 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-20eb4461-ddd6-441c-ae75-15b6b4e52bcb" acquired by "delete_volume" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:52 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e659fd9-c445-48b9-813d-6d2eab93c33f]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-87bf5f1f-4c27-4941-a3a7-a6ccbfe14205 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:52 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985 1073741824" returned: 0 in 1.186s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:52 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb Jul 07 17:42:52 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:52 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985 Jul 07 17:42:52 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:53 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f5a3b160-e935-47a6-966a-4db42db4eecc tempest-ProjectReaderTests-1334318987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 1.042s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-f5a3b160-e935-47a6-966a-4db42db4eecc tempest-ProjectReaderTests-1334318987 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:53 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-f5a3b160-e935-47a6-966a-4db42db4eecc tempest-ProjectReaderTests-1334318987 None] Deleted volume successfully. Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f5a3b160-e935-47a6-966a-4db42db4eecc tempest-ProjectReaderTests-1334318987 None] Lock "cinder-8f312270-146c-4bdb-ade9-7ccdaff792fa-delete_volume" released by "delete_volume" :: held 3.199s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ca16a0a9-b3eb-421e-ab42-6a6e727f0f56 tempest-CinderUnicodeTest-1025874071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Flow 'volume_create_manager' (fcebe5de-bb9b-40b3-8e4f-716352cda202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b48481-27e4-401f-a542-7f6ddef34ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b48481-27e4-401f-a542-7f6ddef34ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1410455234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947a99f9-d470-47d5-96ad-e9a494f6de73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09c3d033da24c16bbcaed97af3e5e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:53Z,use_quota=True,user_id='b7bc2b5958a04f199734c1be8706af05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bbcd55e-84ae-452e-856f-37595d949bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bbcd55e-84ae-452e-856f-37595d949bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe188b4-7986-4efb-bb62-580efd8d2c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe188b4-7986-4efb-bb62-580efd8d2c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '947a99f9-d470-47d5-96ad-e9a494f6de73', 'volume_name': 'volume-947a99f9-d470-47d5-96ad-e9a494f6de73', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10fabd1c-975b-4d8c-972d-883a1513a13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10fabd1c-975b-4d8c-972d-883a1513a13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830c6842-3544-4e9a-ac69-f420a877f269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:53 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Volume 947a99f9-d470-47d5-96ad-e9a494f6de73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-947a99f9-d470-47d5-96ad-e9a494f6de73', 'volume_size': 1} Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:53 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985" returned: 0 in 0.970s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] <== create_volume: return (2239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.243s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ca16a0a9-b3eb-421e-ab42-6a6e727f0f56 tempest-CinderUnicodeTest-1025874071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.378s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-ca16a0a9-b3eb-421e-ab42-6a6e727f0f56 tempest-CinderUnicodeTest-1025874071 None] Creating offline snapshot 123aa443-0d09-41a7-b7fe-b876bc53ea29 of volume 6d72ea3b-610f-4667-9e3a-73de0da55b64 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:42:53 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faefa4c6-f551-45bb-88a5-902efc6dcf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0235730b-8f8f-470c-906b-a4c8dad9a985', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48763bd0-a860-43e1-bd9c-69c9ec9759a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[328afda1-ddae-4c81-a28a-291dd9dff893]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ca16a0a9-b3eb-421e-ab42-6a6e727f0f56 tempest-CinderUnicodeTest-1025874071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-87bf5f1f-4c27-4941-a3a7-a6ccbfe14205 tempest-ProjectReaderTests-1690191251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb" returned: 0 in 1.164s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-87bf5f1f-4c27-4941-a3a7-a6ccbfe14205 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:53 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Volume volume-0235730b-8f8f-470c-906b-a4c8dad9a985 (0235730b-8f8f-470c-906b-a4c8dad9a985): created successfully Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48763bd0-a860-43e1-bd9c-69c9ec9759a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:53 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb Jul 07 17:42:53 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:53 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Flow 'volume_create_manager' (a8949c0a-f117-4243-86c3-6bda6985869a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:53 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-1479c35e-0195-4ce6-a90e-182d2023d965 tempest-ProjectMemberTests-1160045297 None] Created volume successfully. Jul 07 17:42:53 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64 Jul 07 17:42:53 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:54 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-87bf5f1f-4c27-4941-a3a7-a6ccbfe14205 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-20eb4461-ddd6-441c-ae75-15b6b4e52bcb" returned: 0 in 0.785s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:54 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-87bf5f1f-4c27-4941-a3a7-a6ccbfe14205 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-20eb4461-ddd6-441c-ae75-15b6b4e52bcb" released by "delete_volume" :: held 2.033s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:54 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-87bf5f1f-4c27-4941-a3a7-a6ccbfe14205 tempest-ProjectReaderTests-1690191251 None] Created reservations ['a3a26e9a-be93-4d48-a363-1ce37dfa2e08', 'dd9d637a-6749-4a64-b559-4c40ba511df7', '358aa917-408a-4c59-8f29-d60bfa00e9ab', 'c4062d00-5bc5-4843-9148-e10ff5273ccb'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:42:54 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ca16a0a9-b3eb-421e-ab42-6a6e727f0f56 tempest-CinderUnicodeTest-1025874071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64" returned: 0 in 0.961s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ca16a0a9-b3eb-421e-ab42-6a6e727f0f56 tempest-CinderUnicodeTest-1025874071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.123aa443-0d09-41a7-b7fe-b876bc53ea29 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:54 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.123aa443-0d09-41a7-b7fe-b876bc53ea29 1G Jul 07 17:42:54 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-87bf5f1f-4c27-4941-a3a7-a6ccbfe14205 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-87bf5f1f-4c27-4941-a3a7-a6ccbfe14205 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:54 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-87bf5f1f-4c27-4941-a3a7-a6ccbfe14205 tempest-ProjectReaderTests-1690191251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:54 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-87bf5f1f-4c27-4941-a3a7-a6ccbfe14205 tempest-ProjectReaderTests-1690191251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-87bf5f1f-4c27-4941-a3a7-a6ccbfe14205 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-87bf5f1f-4c27-4941-a3a7-a6ccbfe14205 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:54 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:42:54 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b006edaf-dcbe-453d-9718-c04c5913267f tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:55 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:42:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Flow 'volume_create_manager' (0ed4ec8f-3177-4b3a-aa66-2923c4ecbaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:42:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21366b9d-0a9b-466a-808f-607f92decc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21366b9d-0a9b-466a-808f-607f92decc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2049947326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d4c9340-5de0-4f49-b1fc-53e455de133c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ac77c0e4184ec79759fdc2759452f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:55Z,use_quota=True,user_id='432b342bf7cf42968fe570ca1f4ae255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef92672-da46-4484-a493-3479de032b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef92672-da46-4484-a493-3479de032b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14791a67-46d5-43be-99dc-99165f519035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14791a67-46d5-43be-99dc-99165f519035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d4c9340-5de0-4f49-b1fc-53e455de133c', 'volume_name': 'volume-6d4c9340-5de0-4f49-b1fc-53e455de133c', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee7ba4b6-cafa-4289-9e7f-d054e15fd202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee7ba4b6-cafa-4289-9e7f-d054e15fd202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:42:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6fef8fb-b69e-4136-af10-ea18ab82d29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:42:55 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Volume 6d4c9340-5de0-4f49-b1fc-53e455de133c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d4c9340-5de0-4f49-b1fc-53e455de133c', 'volume_size': 1} Jul 07 17:42:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:55 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:55 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-87bf5f1f-4c27-4941-a3a7-a6ccbfe14205 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.993s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:55 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-87bf5f1f-4c27-4941-a3a7-a6ccbfe14205 tempest-ProjectReaderTests-1690191251 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ca16a0a9-b3eb-421e-ab42-6a6e727f0f56 tempest-CinderUnicodeTest-1025874071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.123aa443-0d09-41a7-b7fe-b876bc53ea29 1G" returned: 0 in 1.064s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ca16a0a9-b3eb-421e-ab42-6a6e727f0f56 tempest-CinderUnicodeTest-1025874071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d72ea3b-610f-4667-9e3a-73de0da55b64 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.123aa443-0d09-41a7-b7fe-b876bc53ea29 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:55 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-87bf5f1f-4c27-4941-a3a7-a6ccbfe14205 tempest-ProjectReaderTests-1690191251 None] Deleted volume successfully. Jul 07 17:42:55 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d72ea3b-610f-4667-9e3a-73de0da55b64 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.123aa443-0d09-41a7-b7fe-b876bc53ea29 Jul 07 17:42:55 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:55 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-87bf5f1f-4c27-4941-a3a7-a6ccbfe14205 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-20eb4461-ddd6-441c-ae75-15b6b4e52bcb-delete_volume" released by "delete_volume" :: held 3.356s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:42:56 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ca16a0a9-b3eb-421e-ab42-6a6e727f0f56 tempest-CinderUnicodeTest-1025874071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d72ea3b-610f-4667-9e3a-73de0da55b64 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.123aa443-0d09-41a7-b7fe-b876bc53ea29" returned: 0 in 0.723s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:56 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-ca16a0a9-b3eb-421e-ab42-6a6e727f0f56 tempest-CinderUnicodeTest-1025874071 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.123aa443-0d09-41a7-b7fe-b876bc53ea29 is being set with open permissions: ugo+rw Jul 07 17:42:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ca16a0a9-b3eb-421e-ab42-6a6e727f0f56 tempest-CinderUnicodeTest-1025874071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.123aa443-0d09-41a7-b7fe-b876bc53ea29 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:56 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.123aa443-0d09-41a7-b7fe-b876bc53ea29 Jul 07 17:42:56 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:42:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:56 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:42:56 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:57 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ca16a0a9-b3eb-421e-ab42-6a6e727f0f56 tempest-CinderUnicodeTest-1025874071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.123aa443-0d09-41a7-b7fe-b876bc53ea29" returned: 0 in 0.712s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ca16a0a9-b3eb-421e-ab42-6a6e727f0f56 tempest-CinderUnicodeTest-1025874071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:57 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.info Jul 07 17:42:57 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:57 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.744s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:57 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:42:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:42:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:42:58 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ca16a0a9-b3eb-421e-ab42-6a6e727f0f56 tempest-CinderUnicodeTest-1025874071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.info" returned: 0 in 0.715s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:58 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-ca16a0a9-b3eb-421e-ab42-6a6e727f0f56 tempest-CinderUnicodeTest-1025874071 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.info is being set with open permissions: ugo+rw Jul 07 17:42:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ca16a0a9-b3eb-421e-ab42-6a6e727f0f56 tempest-CinderUnicodeTest-1025874071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:58 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.info Jul 07 17:42:58 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:58 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ca16a0a9-b3eb-421e-ab42-6a6e727f0f56 tempest-CinderUnicodeTest-1025874071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.info" returned: 0 in 0.697s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ca16a0a9-b3eb-421e-ab42-6a6e727f0f56 tempest-CinderUnicodeTest-1025874071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.998s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.274s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:58 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1410455234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947a99f9-d470-47d5-96ad-e9a494f6de73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09c3d033da24c16bbcaed97af3e5e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:53Z,use_quota=True,user_id='b7bc2b5958a04f199734c1be8706af05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:42:58 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Creating volume 947a99f9-d470-47d5-96ad-e9a494f6de73 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:42:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:42:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:42:58 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:42:58 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:42:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:42:58 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:42:58 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:42:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-947a99f9-d470-47d5-96ad-e9a494f6de73 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:58 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-947a99f9-d470-47d5-96ad-e9a494f6de73 1073741824 Jul 07 17:42:58 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:58 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-ca16a0a9-b3eb-421e-ab42-6a6e727f0f56 tempest-CinderUnicodeTest-1025874071 None] Create snapshot completed successfully Jul 07 17:42:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cb0341ab-ab73-430a-9c1f-320d95ce006b tempest-CinderUnicodeTest-1025874071 None] Acquiring lock "cinder-123aa443-0d09-41a7-b7fe-b876bc53ea29-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cb0341ab-ab73-430a-9c1f-320d95ce006b tempest-CinderUnicodeTest-1025874071 None] Lock "cinder-123aa443-0d09-41a7-b7fe-b876bc53ea29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cb0341ab-ab73-430a-9c1f-320d95ce006b tempest-CinderUnicodeTest-1025874071 None] Acquiring lock "cinder-quobyte-6d72ea3b-610f-4667-9e3a-73de0da55b64" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cb0341ab-ab73-430a-9c1f-320d95ce006b tempest-CinderUnicodeTest-1025874071 None] Lock "cinder-quobyte-6d72ea3b-610f-4667-9e3a-73de0da55b64" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cb0341ab-ab73-430a-9c1f-320d95ce006b tempest-CinderUnicodeTest-1025874071 None] Acquiring lock "cinder-quobyte-123aa443-0d09-41a7-b7fe-b876bc53ea29" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:42:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cb0341ab-ab73-430a-9c1f-320d95ce006b tempest-CinderUnicodeTest-1025874071 None] Lock "cinder-quobyte-123aa443-0d09-41a7-b7fe-b876bc53ea29" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:42:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-cb0341ab-ab73-430a-9c1f-320d95ce006b tempest-CinderUnicodeTest-1025874071 None] Deleting offline snapshot 123aa443-0d09-41a7-b7fe-b876bc53ea29 of volume 6d72ea3b-610f-4667-9e3a-73de0da55b64 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:42:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-cb0341ab-ab73-430a-9c1f-320d95ce006b tempest-CinderUnicodeTest-1025874071 None] snapshot_file for this snap is: volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.123aa443-0d09-41a7-b7fe-b876bc53ea29 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:42:59 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[453ceada-c606-47bf-93a0-21dd11098410]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:42:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cb0341ab-ab73-430a-9c1f-320d95ce006b tempest-CinderUnicodeTest-1025874071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.123aa443-0d09-41a7-b7fe-b876bc53ea29 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:59 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.123aa443-0d09-41a7-b7fe-b876bc53ea29 Jul 07 17:42:59 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:59 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-947a99f9-d470-47d5-96ad-e9a494f6de73 1073741824" returned: 0 in 1.054s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-947a99f9-d470-47d5-96ad-e9a494f6de73 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:59 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-947a99f9-d470-47d5-96ad-e9a494f6de73 Jul 07 17:42:59 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:00 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cb0341ab-ab73-430a-9c1f-320d95ce006b tempest-CinderUnicodeTest-1025874071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.123aa443-0d09-41a7-b7fe-b876bc53ea29" returned: 0 in 0.906s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:00 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-cb0341ab-ab73-430a-9c1f-320d95ce006b tempest-CinderUnicodeTest-1025874071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d72ea3b-610f-4667-9e3a-73de0da55b64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:43:00 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-947a99f9-d470-47d5-96ad-e9a494f6de73" returned: 0 in 0.748s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:00 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b006edaf-dcbe-453d-9718-c04c5913267f tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.652s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:00 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8a9fd5-264c-4503-a6f9-66bc74c7931a]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cb0341ab-ab73-430a-9c1f-320d95ce006b tempest-CinderUnicodeTest-1025874071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:00 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830c6842-3544-4e9a-ac69-f420a877f269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-947a99f9-d470-47d5-96ad-e9a494f6de73', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:00 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe751718-afab-4753-89ae-72f1656210be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:00 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-b006edaf-dcbe-453d-9718-c04c5913267f tempest-ProjectMemberTests-1160045297 None] Creating offline snapshot 84a0abb1-4929-42e8-ad11-c047a55c0c2f of volume 0235730b-8f8f-470c-906b-a4c8dad9a985 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:43:00 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Volume volume-947a99f9-d470-47d5-96ad-e9a494f6de73 (947a99f9-d470-47d5-96ad-e9a494f6de73): created successfully Jul 07 17:43:00 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe751718-afab-4753-89ae-72f1656210be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:00 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Flow 'volume_create_manager' (fcebe5de-bb9b-40b3-8e4f-716352cda202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:00 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4b6477-e98c-43c1-b504-238089227ead]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b006edaf-dcbe-453d-9718-c04c5913267f tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:00 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-ca401377-cbbc-455d-8ad6-af8047d93668 tempest-ProjectReaderTests-1334318987 None] Created volume successfully. Jul 07 17:43:00 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64 Jul 07 17:43:00 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:00 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985 Jul 07 17:43:00 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:01 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cb0341ab-ab73-430a-9c1f-320d95ce006b tempest-CinderUnicodeTest-1025874071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64" returned: 0 in 0.896s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cb0341ab-ab73-430a-9c1f-320d95ce006b tempest-CinderUnicodeTest-1025874071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.123aa443-0d09-41a7-b7fe-b876bc53ea29 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:01 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.123aa443-0d09-41a7-b7fe-b876bc53ea29 Jul 07 17:43:01 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:01 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b006edaf-dcbe-453d-9718-c04c5913267f tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985" returned: 0 in 0.861s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b006edaf-dcbe-453d-9718-c04c5913267f tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.84a0abb1-4929-42e8-ad11-c047a55c0c2f 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:01 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.84a0abb1-4929-42e8-ad11-c047a55c0c2f 1G Jul 07 17:43:01 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7664542d-72c1-4310-afb7-574d99da5956 tempest-ProjectReaderTests-1334318987 None] Acquiring lock "cinder-947a99f9-d470-47d5-96ad-e9a494f6de73-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7664542d-72c1-4310-afb7-574d99da5956 tempest-ProjectReaderTests-1334318987 None] Lock "cinder-947a99f9-d470-47d5-96ad-e9a494f6de73-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:01 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:INSERT=42,cinder:UPDATE=178,cinder:SELECT=130,cinder:DELETE=10 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:43:01 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=125,cinder:INSERT=50,cinder:UPDATE=157,cinder:DELETE=18 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:43:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7664542d-72c1-4310-afb7-574d99da5956 tempest-ProjectReaderTests-1334318987 None] Acquiring lock "cinder-quobyte-947a99f9-d470-47d5-96ad-e9a494f6de73" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7664542d-72c1-4310-afb7-574d99da5956 tempest-ProjectReaderTests-1334318987 None] Lock "cinder-quobyte-947a99f9-d470-47d5-96ad-e9a494f6de73" acquired by "delete_volume" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:01 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[443270f4-ed8c-4ea9-a636-cc523ec4fc82]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7664542d-72c1-4310-afb7-574d99da5956 tempest-ProjectReaderTests-1334318987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-947a99f9-d470-47d5-96ad-e9a494f6de73 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:02 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-947a99f9-d470-47d5-96ad-e9a494f6de73 Jul 07 17:43:02 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:02 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cb0341ab-ab73-430a-9c1f-320d95ce006b tempest-CinderUnicodeTest-1025874071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.123aa443-0d09-41a7-b7fe-b876bc53ea29" returned: 0 in 0.972s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cb0341ab-ab73-430a-9c1f-320d95ce006b tempest-CinderUnicodeTest-1025874071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.123aa443-0d09-41a7-b7fe-b876bc53ea29 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:02 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.123aa443-0d09-41a7-b7fe-b876bc53ea29 Jul 07 17:43:02 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:02 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b006edaf-dcbe-453d-9718-c04c5913267f tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.84a0abb1-4929-42e8-ad11-c047a55c0c2f 1G" returned: 0 in 1.046s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b006edaf-dcbe-453d-9718-c04c5913267f tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0235730b-8f8f-470c-906b-a4c8dad9a985 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.84a0abb1-4929-42e8-ad11-c047a55c0c2f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:02 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0235730b-8f8f-470c-906b-a4c8dad9a985 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.84a0abb1-4929-42e8-ad11-c047a55c0c2f Jul 07 17:43:02 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:02 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7664542d-72c1-4310-afb7-574d99da5956 tempest-ProjectReaderTests-1334318987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-947a99f9-d470-47d5-96ad-e9a494f6de73" returned: 0 in 0.889s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7664542d-72c1-4310-afb7-574d99da5956 tempest-ProjectReaderTests-1334318987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-947a99f9-d470-47d5-96ad-e9a494f6de73 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:02 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-947a99f9-d470-47d5-96ad-e9a494f6de73 Jul 07 17:43:02 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:03 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-cb0341ab-ab73-430a-9c1f-320d95ce006b tempest-CinderUnicodeTest-1025874071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64.123aa443-0d09-41a7-b7fe-b876bc53ea29" returned: 0 in 0.810s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cb0341ab-ab73-430a-9c1f-320d95ce006b tempest-CinderUnicodeTest-1025874071 None] Lock "cinder-quobyte-123aa443-0d09-41a7-b7fe-b876bc53ea29" released by "_delete_snapshot" :: held 3.737s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cb0341ab-ab73-430a-9c1f-320d95ce006b tempest-CinderUnicodeTest-1025874071 None] Lock "cinder-quobyte-6d72ea3b-610f-4667-9e3a-73de0da55b64" released by "delete_snapshot" :: held 3.767s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:03 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-cb0341ab-ab73-430a-9c1f-320d95ce006b tempest-CinderUnicodeTest-1025874071 None] Created reservations ['72f79fa9-985f-4403-976d-79d6a9985bd9', 'a7b4807f-9ec8-4f11-92e1-ba38827270e3', '11e1907a-bb5c-4d20-b959-0926f5f2dad9', 'f288d158-6384-4763-bb2d-66a2fef2c413'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:03 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b006edaf-dcbe-453d-9718-c04c5913267f tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0235730b-8f8f-470c-906b-a4c8dad9a985 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.84a0abb1-4929-42e8-ad11-c047a55c0c2f" returned: 0 in 0.859s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:03 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-b006edaf-dcbe-453d-9718-c04c5913267f tempest-ProjectMemberTests-1160045297 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.84a0abb1-4929-42e8-ad11-c047a55c0c2f is being set with open permissions: ugo+rw Jul 07 17:43:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b006edaf-dcbe-453d-9718-c04c5913267f tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.84a0abb1-4929-42e8-ad11-c047a55c0c2f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:03 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.84a0abb1-4929-42e8-ad11-c047a55c0c2f Jul 07 17:43:03 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:03 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-cb0341ab-ab73-430a-9c1f-320d95ce006b tempest-CinderUnicodeTest-1025874071 None] Delete snapshot completed successfully. Jul 07 17:43:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-cb0341ab-ab73-430a-9c1f-320d95ce006b tempest-CinderUnicodeTest-1025874071 None] Lock "cinder-123aa443-0d09-41a7-b7fe-b876bc53ea29-delete_snapshot" released by "delete_snapshot" :: held 3.972s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:03 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7664542d-72c1-4310-afb7-574d99da5956 tempest-ProjectReaderTests-1334318987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-947a99f9-d470-47d5-96ad-e9a494f6de73" returned: 0 in 0.813s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7664542d-72c1-4310-afb7-574d99da5956 tempest-ProjectReaderTests-1334318987 None] Lock "cinder-quobyte-947a99f9-d470-47d5-96ad-e9a494f6de73" released by "delete_volume" :: held 1.757s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:03 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-7664542d-72c1-4310-afb7-574d99da5956 tempest-ProjectReaderTests-1334318987 None] Created reservations ['b5ab7388-142d-4e8f-a74d-0349c97ec5b0', '7840a3e7-b44b-4bfb-9641-a16c170d86d9', 'eb0724a9-4ee3-4330-8b39-446c7f5bfee5', '64e04caf-85ce-497f-b1f5-c8334a465126'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7664542d-72c1-4310-afb7-574d99da5956 tempest-ProjectReaderTests-1334318987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7664542d-72c1-4310-afb7-574d99da5956 tempest-ProjectReaderTests-1334318987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:03 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7664542d-72c1-4310-afb7-574d99da5956 tempest-ProjectReaderTests-1334318987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:03 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7664542d-72c1-4310-afb7-574d99da5956 tempest-ProjectReaderTests-1334318987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7664542d-72c1-4310-afb7-574d99da5956 tempest-ProjectReaderTests-1334318987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7664542d-72c1-4310-afb7-574d99da5956 tempest-ProjectReaderTests-1334318987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0068e520-787d-42f2-807f-9e0aebc30657 tempest-CinderUnicodeTest-1025874071 None] Acquiring lock "cinder-6d72ea3b-610f-4667-9e3a-73de0da55b64-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:03 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:43:03 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:03 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0068e520-787d-42f2-807f-9e0aebc30657 tempest-CinderUnicodeTest-1025874071 None] Lock "cinder-6d72ea3b-610f-4667-9e3a-73de0da55b64-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:04 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0068e520-787d-42f2-807f-9e0aebc30657 tempest-CinderUnicodeTest-1025874071 None] Acquiring lock "cinder-quobyte-6d72ea3b-610f-4667-9e3a-73de0da55b64" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:04 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0068e520-787d-42f2-807f-9e0aebc30657 tempest-CinderUnicodeTest-1025874071 None] Lock "cinder-quobyte-6d72ea3b-610f-4667-9e3a-73de0da55b64" acquired by "delete_volume" :: waited 0.026s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:04 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[009df4dc-2721-4dee-b0f5-3fc3bce5ffa2]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0068e520-787d-42f2-807f-9e0aebc30657 tempest-CinderUnicodeTest-1025874071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:04 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64 Jul 07 17:43:04 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:04 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b006edaf-dcbe-453d-9718-c04c5913267f tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.84a0abb1-4929-42e8-ad11-c047a55c0c2f" returned: 0 in 0.876s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b006edaf-dcbe-453d-9718-c04c5913267f tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:04 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.info Jul 07 17:43:04 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:04 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7664542d-72c1-4310-afb7-574d99da5956 tempest-ProjectReaderTests-1334318987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.843s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:04 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-7664542d-72c1-4310-afb7-574d99da5956 tempest-ProjectReaderTests-1334318987 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:04 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-7664542d-72c1-4310-afb7-574d99da5956 tempest-ProjectReaderTests-1334318987 None] Deleted volume successfully. Jul 07 17:43:04 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7664542d-72c1-4310-afb7-574d99da5956 tempest-ProjectReaderTests-1334318987 None] Lock "cinder-947a99f9-d470-47d5-96ad-e9a494f6de73-delete_volume" released by "delete_volume" :: held 2.944s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:05 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0068e520-787d-42f2-807f-9e0aebc30657 tempest-CinderUnicodeTest-1025874071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64" returned: 0 in 1.036s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0068e520-787d-42f2-807f-9e0aebc30657 tempest-CinderUnicodeTest-1025874071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:05 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64 Jul 07 17:43:05 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:05 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b006edaf-dcbe-453d-9718-c04c5913267f tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.info" returned: 0 in 0.843s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:05 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-b006edaf-dcbe-453d-9718-c04c5913267f tempest-ProjectMemberTests-1160045297 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.info is being set with open permissions: ugo+rw Jul 07 17:43:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b006edaf-dcbe-453d-9718-c04c5913267f tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:05 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.info Jul 07 17:43:05 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:05 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0068e520-787d-42f2-807f-9e0aebc30657 tempest-CinderUnicodeTest-1025874071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d72ea3b-610f-4667-9e3a-73de0da55b64" returned: 0 in 0.817s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0068e520-787d-42f2-807f-9e0aebc30657 tempest-CinderUnicodeTest-1025874071 None] Lock "cinder-quobyte-6d72ea3b-610f-4667-9e3a-73de0da55b64" released by "delete_volume" :: held 1.947s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-0068e520-787d-42f2-807f-9e0aebc30657 tempest-CinderUnicodeTest-1025874071 None] Created reservations ['5f86c61c-fdd7-4dbd-8bda-af33c687f166', 'f329b2c3-3c74-4c1e-bc3c-dc28798f16da', 'facc5696-b526-47d7-9ec7-ce1f44890701', 'ed907536-d979-495e-956c-57f527c54b7a'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:06 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b006edaf-dcbe-453d-9718-c04c5913267f tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.info" returned: 0 in 0.832s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b006edaf-dcbe-453d-9718-c04c5913267f tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.512s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.510s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2049947326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d4c9340-5de0-4f49-b1fc-53e455de133c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ac77c0e4184ec79759fdc2759452f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:42:55Z,use_quota=True,user_id='432b342bf7cf42968fe570ca1f4ae255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Creating volume 6d4c9340-5de0-4f49-b1fc-53e455de133c {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:06 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:06 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c 1073741824 Jul 07 17:43:06 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:06 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b006edaf-dcbe-453d-9718-c04c5913267f tempest-ProjectMemberTests-1160045297 None] Create snapshot completed successfully Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0068e520-787d-42f2-807f-9e0aebc30657 tempest-CinderUnicodeTest-1025874071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0068e520-787d-42f2-807f-9e0aebc30657 tempest-CinderUnicodeTest-1025874071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0068e520-787d-42f2-807f-9e0aebc30657 tempest-CinderUnicodeTest-1025874071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-0068e520-787d-42f2-807f-9e0aebc30657 tempest-CinderUnicodeTest-1025874071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-0068e520-787d-42f2-807f-9e0aebc30657 tempest-CinderUnicodeTest-1025874071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0068e520-787d-42f2-807f-9e0aebc30657 tempest-CinderUnicodeTest-1025874071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:06 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:43:06 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-04417472-7bec-4a64-8e8a-eab4686c601f tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-84a0abb1-4929-42e8-ad11-c047a55c0c2f-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-04417472-7bec-4a64-8e8a-eab4686c601f tempest-ProjectMemberTests-1160045297 None] Lock "cinder-84a0abb1-4929-42e8-ad11-c047a55c0c2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-04417472-7bec-4a64-8e8a-eab4686c601f tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-0235730b-8f8f-470c-906b-a4c8dad9a985" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-04417472-7bec-4a64-8e8a-eab4686c601f tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-0235730b-8f8f-470c-906b-a4c8dad9a985" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-04417472-7bec-4a64-8e8a-eab4686c601f tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-84a0abb1-4929-42e8-ad11-c047a55c0c2f" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-04417472-7bec-4a64-8e8a-eab4686c601f tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-84a0abb1-4929-42e8-ad11-c047a55c0c2f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-04417472-7bec-4a64-8e8a-eab4686c601f tempest-ProjectMemberTests-1160045297 None] Deleting offline snapshot 84a0abb1-4929-42e8-ad11-c047a55c0c2f of volume 0235730b-8f8f-470c-906b-a4c8dad9a985 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-04417472-7bec-4a64-8e8a-eab4686c601f tempest-ProjectMemberTests-1160045297 None] snapshot_file for this snap is: volume-0235730b-8f8f-470c-906b-a4c8dad9a985.84a0abb1-4929-42e8-ad11-c047a55c0c2f {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c092e2e-cb93-441d-83b8-4cbb76cc1353]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-04417472-7bec-4a64-8e8a-eab4686c601f tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.84a0abb1-4929-42e8-ad11-c047a55c0c2f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:06 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.84a0abb1-4929-42e8-ad11-c047a55c0c2f Jul 07 17:43:06 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:07 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0068e520-787d-42f2-807f-9e0aebc30657 tempest-CinderUnicodeTest-1025874071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.803s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:07 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-0068e520-787d-42f2-807f-9e0aebc30657 tempest-CinderUnicodeTest-1025874071 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:07 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-0068e520-787d-42f2-807f-9e0aebc30657 tempest-CinderUnicodeTest-1025874071 None] Deleted volume successfully. Jul 07 17:43:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0068e520-787d-42f2-807f-9e0aebc30657 tempest-CinderUnicodeTest-1025874071 None] Lock "cinder-6d72ea3b-610f-4667-9e3a-73de0da55b64-delete_volume" released by "delete_volume" :: held 3.157s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:07 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c 1073741824" returned: 0 in 1.188s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e54366a4-5ba8-4ba5-bf28-ef877f1eb379 tempest-CinderUnicodeTest-1025874071 None] Acquiring lock "cinder-c7bc7af6-7837-42cc-83f1-20bcb2127412-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e54366a4-5ba8-4ba5-bf28-ef877f1eb379 tempest-CinderUnicodeTest-1025874071 None] Lock "cinder-c7bc7af6-7837-42cc-83f1-20bcb2127412-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:07 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c Jul 07 17:43:07 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e54366a4-5ba8-4ba5-bf28-ef877f1eb379 tempest-CinderUnicodeTest-1025874071 None] Acquiring lock "cinder-quobyte-c7bc7af6-7837-42cc-83f1-20bcb2127412" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:07 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e54366a4-5ba8-4ba5-bf28-ef877f1eb379 tempest-CinderUnicodeTest-1025874071 None] Lock "cinder-quobyte-c7bc7af6-7837-42cc-83f1-20bcb2127412" acquired by "delete_volume" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:07 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[65acdce5-7377-4617-8961-4d2c1fd2939f]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e54366a4-5ba8-4ba5-bf28-ef877f1eb379 tempest-CinderUnicodeTest-1025874071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c7bc7af6-7837-42cc-83f1-20bcb2127412 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:07 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c7bc7af6-7837-42cc-83f1-20bcb2127412 Jul 07 17:43:07 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:07 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-04417472-7bec-4a64-8e8a-eab4686c601f tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.84a0abb1-4929-42e8-ad11-c047a55c0c2f" returned: 0 in 0.963s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-04417472-7bec-4a64-8e8a-eab4686c601f tempest-ProjectMemberTests-1160045297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0235730b-8f8f-470c-906b-a4c8dad9a985(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:43:07 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[1463ced3-64a2-4279-a4e4-e0d3885ed84c]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-04417472-7bec-4a64-8e8a-eab4686c601f tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:07 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985 Jul 07 17:43:07 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:08 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c" returned: 0 in 0.727s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6fef8fb-b69e-4136-af10-ea18ab82d29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d4c9340-5de0-4f49-b1fc-53e455de133c', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11877025-2423-42fb-8252-056869890ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:08 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Volume volume-6d4c9340-5de0-4f49-b1fc-53e455de133c (6d4c9340-5de0-4f49-b1fc-53e455de133c): created successfully Jul 07 17:43:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11877025-2423-42fb-8252-056869890ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:08 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Flow 'volume_create_manager' (0ed4ec8f-3177-4b3a-aa66-2923c4ecbaab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:08 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-f3df8e3a-2580-4a5a-95b4-52a2d325f036 tempest-ProjectReaderTests-1690191251 None] Created volume successfully. Jul 07 17:43:08 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e54366a4-5ba8-4ba5-bf28-ef877f1eb379 tempest-CinderUnicodeTest-1025874071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c7bc7af6-7837-42cc-83f1-20bcb2127412" returned: 0 in 0.921s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e54366a4-5ba8-4ba5-bf28-ef877f1eb379 tempest-CinderUnicodeTest-1025874071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c7bc7af6-7837-42cc-83f1-20bcb2127412 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:08 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c7bc7af6-7837-42cc-83f1-20bcb2127412 Jul 07 17:43:08 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4bef2809-b80a-4f15-ad84-bd69c0082b29 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4bef2809-b80a-4f15-ad84-bd69c0082b29 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:08 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:08 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-4bef2809-b80a-4f15-ad84-bd69c0082b29 tempest-ProjectReaderTests-1690191251 None] Creating offline snapshot 44a85257-d6e9-4304-be74-64377a96e0a2 of volume 6d4c9340-5de0-4f49-b1fc-53e455de133c {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:43:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-04417472-7bec-4a64-8e8a-eab4686c601f tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985" returned: 0 in 0.926s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-04417472-7bec-4a64-8e8a-eab4686c601f tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.84a0abb1-4929-42e8-ad11-c047a55c0c2f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:08 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc3a312-0731-4a3f-aaa2-c169c1e466d1]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4bef2809-b80a-4f15-ad84-bd69c0082b29 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:08 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.84a0abb1-4929-42e8-ad11-c047a55c0c2f Jul 07 17:43:08 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:08 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c Jul 07 17:43:08 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:09 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e54366a4-5ba8-4ba5-bf28-ef877f1eb379 tempest-CinderUnicodeTest-1025874071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-c7bc7af6-7837-42cc-83f1-20bcb2127412" returned: 0 in 0.792s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:09 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e54366a4-5ba8-4ba5-bf28-ef877f1eb379 tempest-CinderUnicodeTest-1025874071 None] Lock "cinder-quobyte-c7bc7af6-7837-42cc-83f1-20bcb2127412" released by "delete_volume" :: held 1.769s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:09 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-e54366a4-5ba8-4ba5-bf28-ef877f1eb379 tempest-CinderUnicodeTest-1025874071 None] Created reservations ['392cba90-c0d3-4cb6-8b31-044f42e59cf8', 'fad1d9b4-bef9-4788-aff0-ab0ddc19ab2e', 'b6878ff0-2a2e-4d6e-af08-b0b129290c6f', '576fd70f-3122-47ac-a600-f6b03faa9024'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e54366a4-5ba8-4ba5-bf28-ef877f1eb379 tempest-CinderUnicodeTest-1025874071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e54366a4-5ba8-4ba5-bf28-ef877f1eb379 tempest-CinderUnicodeTest-1025874071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:09 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e54366a4-5ba8-4ba5-bf28-ef877f1eb379 tempest-CinderUnicodeTest-1025874071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:09 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-e54366a4-5ba8-4ba5-bf28-ef877f1eb379 tempest-CinderUnicodeTest-1025874071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-e54366a4-5ba8-4ba5-bf28-ef877f1eb379 tempest-CinderUnicodeTest-1025874071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e54366a4-5ba8-4ba5-bf28-ef877f1eb379 tempest-CinderUnicodeTest-1025874071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:09 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:43:09 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:09 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4bef2809-b80a-4f15-ad84-bd69c0082b29 tempest-ProjectReaderTests-1690191251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c" returned: 0 in 0.839s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4bef2809-b80a-4f15-ad84-bd69c0082b29 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.44a85257-d6e9-4304-be74-64377a96e0a2 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:09 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.44a85257-d6e9-4304-be74-64377a96e0a2 1G Jul 07 17:43:09 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:09 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-04417472-7bec-4a64-8e8a-eab4686c601f tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.84a0abb1-4929-42e8-ad11-c047a55c0c2f" returned: 0 in 0.894s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-04417472-7bec-4a64-8e8a-eab4686c601f tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.84a0abb1-4929-42e8-ad11-c047a55c0c2f {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:09 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.84a0abb1-4929-42e8-ad11-c047a55c0c2f Jul 07 17:43:09 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:10 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-e54366a4-5ba8-4ba5-bf28-ef877f1eb379 tempest-CinderUnicodeTest-1025874071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.859s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:10 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-e54366a4-5ba8-4ba5-bf28-ef877f1eb379 tempest-CinderUnicodeTest-1025874071 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:10 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-e54366a4-5ba8-4ba5-bf28-ef877f1eb379 tempest-CinderUnicodeTest-1025874071 None] Deleted volume successfully. Jul 07 17:43:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-e54366a4-5ba8-4ba5-bf28-ef877f1eb379 tempest-CinderUnicodeTest-1025874071 None] Lock "cinder-c7bc7af6-7837-42cc-83f1-20bcb2127412-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:10 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-04417472-7bec-4a64-8e8a-eab4686c601f tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985.84a0abb1-4929-42e8-ad11-c047a55c0c2f" returned: 0 in 0.882s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:10 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4bef2809-b80a-4f15-ad84-bd69c0082b29 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.44a85257-d6e9-4304-be74-64377a96e0a2 1G" returned: 0 in 0.965s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4bef2809-b80a-4f15-ad84-bd69c0082b29 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d4c9340-5de0-4f49-b1fc-53e455de133c -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.44a85257-d6e9-4304-be74-64377a96e0a2 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-04417472-7bec-4a64-8e8a-eab4686c601f tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-84a0abb1-4929-42e8-ad11-c047a55c0c2f" released by "_delete_snapshot" :: held 3.836s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-04417472-7bec-4a64-8e8a-eab4686c601f tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-0235730b-8f8f-470c-906b-a4c8dad9a985" released by "delete_snapshot" :: held 3.874s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:10 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d4c9340-5de0-4f49-b1fc-53e455de133c -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.44a85257-d6e9-4304-be74-64377a96e0a2 Jul 07 17:43:10 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:10 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-04417472-7bec-4a64-8e8a-eab4686c601f tempest-ProjectMemberTests-1160045297 None] Created reservations ['abd743a0-3a5b-431d-aa84-a2785b67c618', '87c351f0-7628-4b6e-be01-19595b52e453', '08a24404-4fcb-4549-b226-3093841fe740', 'addb9b2c-9ae0-4849-aa54-5428762361c5'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:10 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-04417472-7bec-4a64-8e8a-eab4686c601f tempest-ProjectMemberTests-1160045297 None] Delete snapshot completed successfully. Jul 07 17:43:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-04417472-7bec-4a64-8e8a-eab4686c601f tempest-ProjectMemberTests-1160045297 None] Lock "cinder-84a0abb1-4929-42e8-ad11-c047a55c0c2f-delete_snapshot" released by "delete_snapshot" :: held 4.118s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ef2bd186-d6a4-413f-9ea3-222b083c892c tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-0235730b-8f8f-470c-906b-a4c8dad9a985-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ef2bd186-d6a4-413f-9ea3-222b083c892c tempest-ProjectMemberTests-1160045297 None] Lock "cinder-0235730b-8f8f-470c-906b-a4c8dad9a985-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ef2bd186-d6a4-413f-9ea3-222b083c892c tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-0235730b-8f8f-470c-906b-a4c8dad9a985" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ef2bd186-d6a4-413f-9ea3-222b083c892c tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-0235730b-8f8f-470c-906b-a4c8dad9a985" acquired by "delete_volume" :: waited 0.018s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:11 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b51a655-833f-4c18-a475-3907f3132bd0]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ef2bd186-d6a4-413f-9ea3-222b083c892c tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:11 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985 Jul 07 17:43:11 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:11 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4bef2809-b80a-4f15-ad84-bd69c0082b29 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d4c9340-5de0-4f49-b1fc-53e455de133c -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.44a85257-d6e9-4304-be74-64377a96e0a2" returned: 0 in 0.844s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:11 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-4bef2809-b80a-4f15-ad84-bd69c0082b29 tempest-ProjectReaderTests-1690191251 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.44a85257-d6e9-4304-be74-64377a96e0a2 is being set with open permissions: ugo+rw Jul 07 17:43:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4bef2809-b80a-4f15-ad84-bd69c0082b29 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.44a85257-d6e9-4304-be74-64377a96e0a2 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:11 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.44a85257-d6e9-4304-be74-64377a96e0a2 Jul 07 17:43:11 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:11 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ef2bd186-d6a4-413f-9ea3-222b083c892c tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985" returned: 0 in 0.915s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ef2bd186-d6a4-413f-9ea3-222b083c892c tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:11 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985 Jul 07 17:43:11 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:12 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4bef2809-b80a-4f15-ad84-bd69c0082b29 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.44a85257-d6e9-4304-be74-64377a96e0a2" returned: 0 in 0.713s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4bef2809-b80a-4f15-ad84-bd69c0082b29 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:12 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.info Jul 07 17:43:12 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:12 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ef2bd186-d6a4-413f-9ea3-222b083c892c tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-0235730b-8f8f-470c-906b-a4c8dad9a985" returned: 0 in 0.849s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:12 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ef2bd186-d6a4-413f-9ea3-222b083c892c tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-0235730b-8f8f-470c-906b-a4c8dad9a985" released by "delete_volume" :: held 1.848s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:12 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:12 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-ef2bd186-d6a4-413f-9ea3-222b083c892c tempest-ProjectMemberTests-1160045297 None] Created reservations ['ae6f6e55-d49a-4d08-88b2-b5cbe39f8c53', 'b8579fa8-c006-42dd-92c9-74e1604dd2e5', '54ba12fd-09f2-467b-9bf4-218b3989a4dc', '106d8ce3-7283-4327-9cc8-6f67f91a09e3'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4bef2809-b80a-4f15-ad84-bd69c0082b29 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.info" returned: 0 in 0.810s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:12 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-4bef2809-b80a-4f15-ad84-bd69c0082b29 tempest-ProjectReaderTests-1690191251 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.info is being set with open permissions: ugo+rw Jul 07 17:43:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4bef2809-b80a-4f15-ad84-bd69c0082b29 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:12 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.info Jul 07 17:43:12 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ef2bd186-d6a4-413f-9ea3-222b083c892c tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ef2bd186-d6a4-413f-9ea3-222b083c892c tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ef2bd186-d6a4-413f-9ea3-222b083c892c tempest-ProjectMemberTests-1160045297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-ef2bd186-d6a4-413f-9ea3-222b083c892c tempest-ProjectMemberTests-1160045297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-ef2bd186-d6a4-413f-9ea3-222b083c892c tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ef2bd186-d6a4-413f-9ea3-222b083c892c tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:13 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:43:13 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:13 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4bef2809-b80a-4f15-ad84-bd69c0082b29 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.info" returned: 0 in 0.972s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:13 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4bef2809-b80a-4f15-ad84-bd69c0082b29 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.252s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-ef2bd186-d6a4-413f-9ea3-222b083c892c tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.917s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:13 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-ef2bd186-d6a4-413f-9ea3-222b083c892c tempest-ProjectMemberTests-1160045297 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:13 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-ef2bd186-d6a4-413f-9ea3-222b083c892c tempest-ProjectMemberTests-1160045297 None] Deleted volume successfully. Jul 07 17:43:13 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-4bef2809-b80a-4f15-ad84-bd69c0082b29 tempest-ProjectReaderTests-1690191251 None] Create snapshot completed successfully Jul 07 17:43:13 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-ef2bd186-d6a4-413f-9ea3-222b083c892c tempest-ProjectMemberTests-1160045297 None] Lock "cinder-0235730b-8f8f-470c-906b-a4c8dad9a985-delete_volume" released by "delete_volume" :: held 3.050s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:13 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Flow 'volume_create_manager' (24c8b047-cce6-4919-ada8-08c33c78035c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8106b4c-f2e9-4816-a67c-964aa6435876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8106b4c-f2e9-4816-a67c-964aa6435876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1408840566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5514ac-9add-44ac-b53d-5ee0e394b682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0b58d71fa140d991a236c4f4eef6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:14Z,use_quota=True,user_id='11c2377e77ba472e95fe61cd6ab8ed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf170f8f-cb0c-4e2c-9323-b096a46fa3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf170f8f-cb0c-4e2c-9323-b096a46fa3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f5c88c-2f82-4979-a724-6370aa361c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f5c88c-2f82-4979-a724-6370aa361c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff5514ac-9add-44ac-b53d-5ee0e394b682', 'volume_name': 'volume-ff5514ac-9add-44ac-b53d-5ee0e394b682', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149cfaca-d691-4e61-a0f0-79910369aa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149cfaca-d691-4e61-a0f0-79910369aa7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b7368e-7564-4189-b7e4-2b48971e403f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:14 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Volume ff5514ac-9add-44ac-b53d-5ee0e394b682: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff5514ac-9add-44ac-b53d-5ee0e394b682', 'volume_size': 1} Jul 07 17:43:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1408840566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5514ac-9add-44ac-b53d-5ee0e394b682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0b58d71fa140d991a236c4f4eef6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:14Z,use_quota=True,user_id='11c2377e77ba472e95fe61cd6ab8ed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Creating volume ff5514ac-9add-44ac-b53d-5ee0e394b682 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:14 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:14 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:43:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:14 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682 1073741824 Jul 07 17:43:14 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:14 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b79415cc-4ff6-43ff-bd62-f5eae71a34da tempest-ProjectAdminTests-139980785 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87303) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 17:43:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f02ed5c3-47e7-4d08-a97a-985ef8301187 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-44a85257-d6e9-4304-be74-64377a96e0a2-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f02ed5c3-47e7-4d08-a97a-985ef8301187 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-44a85257-d6e9-4304-be74-64377a96e0a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f02ed5c3-47e7-4d08-a97a-985ef8301187 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-quobyte-6d4c9340-5de0-4f49-b1fc-53e455de133c" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f02ed5c3-47e7-4d08-a97a-985ef8301187 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-6d4c9340-5de0-4f49-b1fc-53e455de133c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f02ed5c3-47e7-4d08-a97a-985ef8301187 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-quobyte-44a85257-d6e9-4304-be74-64377a96e0a2" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f02ed5c3-47e7-4d08-a97a-985ef8301187 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-44a85257-d6e9-4304-be74-64377a96e0a2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-f02ed5c3-47e7-4d08-a97a-985ef8301187 tempest-ProjectReaderTests-1690191251 None] Deleting offline snapshot 44a85257-d6e9-4304-be74-64377a96e0a2 of volume 6d4c9340-5de0-4f49-b1fc-53e455de133c {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:43:15 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-f02ed5c3-47e7-4d08-a97a-985ef8301187 tempest-ProjectReaderTests-1690191251 None] snapshot_file for this snap is: volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.44a85257-d6e9-4304-be74-64377a96e0a2 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:43:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682 1073741824" returned: 0 in 1.075s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:15 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[578647a5-9746-427e-8c55-8f790f315099]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f02ed5c3-47e7-4d08-a97a-985ef8301187 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.44a85257-d6e9-4304-be74-64377a96e0a2 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:15 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682 Jul 07 17:43:15 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:15 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.44a85257-d6e9-4304-be74-64377a96e0a2 Jul 07 17:43:15 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:15 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682" returned: 0 in 0.792s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b7368e-7564-4189-b7e4-2b48971e403f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff5514ac-9add-44ac-b53d-5ee0e394b682', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc43cfb2-efe1-4fc2-978c-c469ff04c28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:16 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Volume volume-ff5514ac-9add-44ac-b53d-5ee0e394b682 (ff5514ac-9add-44ac-b53d-5ee0e394b682): created successfully Jul 07 17:43:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc43cfb2-efe1-4fc2-978c-c469ff04c28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:16 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Flow 'volume_create_manager' (24c8b047-cce6-4919-ada8-08c33c78035c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:16 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-4bd48494-1411-42b9-8b85-8d046159a95e tempest-ProjectMemberTests-1160045297 None] Created volume successfully. Jul 07 17:43:16 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f02ed5c3-47e7-4d08-a97a-985ef8301187 tempest-ProjectReaderTests-1690191251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.44a85257-d6e9-4304-be74-64377a96e0a2" returned: 0 in 1.069s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:16 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-f02ed5c3-47e7-4d08-a97a-985ef8301187 tempest-ProjectReaderTests-1690191251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d4c9340-5de0-4f49-b1fc-53e455de133c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:43:16 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62fb185-337c-4123-ba2f-8a28ca417e49]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f02ed5c3-47e7-4d08-a97a-985ef8301187 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:16 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c Jul 07 17:43:16 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:17 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f02ed5c3-47e7-4d08-a97a-985ef8301187 tempest-ProjectReaderTests-1690191251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c" returned: 0 in 0.926s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f02ed5c3-47e7-4d08-a97a-985ef8301187 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.44a85257-d6e9-4304-be74-64377a96e0a2 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:17 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.44a85257-d6e9-4304-be74-64377a96e0a2 Jul 07 17:43:17 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-fbc7f8d3-a8d6-46b6-b1f2-4d4964abb279 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-fbc7f8d3-a8d6-46b6-b1f2-4d4964abb279 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:17 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-fbc7f8d3-a8d6-46b6-b1f2-4d4964abb279 tempest-ProjectMemberTests-1160045297 None] Creating offline snapshot e67e530c-2097-4c5f-a884-c843a2fc5eb4 of volume ff5514ac-9add-44ac-b53d-5ee0e394b682 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:43:17 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57ba04b-3bac-474f-9e56-73ea3e022903]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fbc7f8d3-a8d6-46b6-b1f2-4d4964abb279 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:17 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682 Jul 07 17:43:17 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:17 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f02ed5c3-47e7-4d08-a97a-985ef8301187 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.44a85257-d6e9-4304-be74-64377a96e0a2" returned: 0 in 0.797s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f02ed5c3-47e7-4d08-a97a-985ef8301187 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.44a85257-d6e9-4304-be74-64377a96e0a2 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:18 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.44a85257-d6e9-4304-be74-64377a96e0a2 Jul 07 17:43:18 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:18 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fbc7f8d3-a8d6-46b6-b1f2-4d4964abb279 tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682" returned: 0 in 0.879s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fbc7f8d3-a8d6-46b6-b1f2-4d4964abb279 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.e67e530c-2097-4c5f-a884-c843a2fc5eb4 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:18 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.e67e530c-2097-4c5f-a884-c843a2fc5eb4 1G Jul 07 17:43:18 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:18 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f02ed5c3-47e7-4d08-a97a-985ef8301187 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c.44a85257-d6e9-4304-be74-64377a96e0a2" returned: 0 in 0.695s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:18 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f02ed5c3-47e7-4d08-a97a-985ef8301187 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-44a85257-d6e9-4304-be74-64377a96e0a2" released by "_delete_snapshot" :: held 3.614s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:18 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f02ed5c3-47e7-4d08-a97a-985ef8301187 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-6d4c9340-5de0-4f49-b1fc-53e455de133c" released by "delete_snapshot" :: held 3.648s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:18 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-f02ed5c3-47e7-4d08-a97a-985ef8301187 tempest-ProjectReaderTests-1690191251 None] Created reservations ['7e066346-d00f-473a-bad1-9bba40dd7356', '58637e6b-c854-4b67-88ca-23780463ecaa', 'b870b41e-45f5-4cf4-bcac-af062f4801cc', '8bcffc78-9ff4-4a7e-a803-8fcfdea6965a'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:18 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-f02ed5c3-47e7-4d08-a97a-985ef8301187 tempest-ProjectReaderTests-1690191251 None] Delete snapshot completed successfully. Jul 07 17:43:18 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-f02ed5c3-47e7-4d08-a97a-985ef8301187 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-44a85257-d6e9-4304-be74-64377a96e0a2-delete_snapshot" released by "delete_snapshot" :: held 3.811s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:19 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fbc7f8d3-a8d6-46b6-b1f2-4d4964abb279 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.e67e530c-2097-4c5f-a884-c843a2fc5eb4 1G" returned: 0 in 0.919s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fbc7f8d3-a8d6-46b6-b1f2-4d4964abb279 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff5514ac-9add-44ac-b53d-5ee0e394b682 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.e67e530c-2097-4c5f-a884-c843a2fc5eb4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:19 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff5514ac-9add-44ac-b53d-5ee0e394b682 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.e67e530c-2097-4c5f-a884-c843a2fc5eb4 Jul 07 17:43:19 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d155f531-74b4-4e4c-9c20-142d2a0cf53c tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-6d4c9340-5de0-4f49-b1fc-53e455de133c-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d155f531-74b4-4e4c-9c20-142d2a0cf53c tempest-ProjectReaderTests-1690191251 None] Lock "cinder-6d4c9340-5de0-4f49-b1fc-53e455de133c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d155f531-74b4-4e4c-9c20-142d2a0cf53c tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-quobyte-6d4c9340-5de0-4f49-b1fc-53e455de133c" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d155f531-74b4-4e4c-9c20-142d2a0cf53c tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-6d4c9340-5de0-4f49-b1fc-53e455de133c" acquired by "delete_volume" :: waited 0.017s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:19 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[2243af61-6f49-45d1-b9ea-1397ae35aa94]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d155f531-74b4-4e4c-9c20-142d2a0cf53c tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:19 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c Jul 07 17:43:19 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:19 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fbc7f8d3-a8d6-46b6-b1f2-4d4964abb279 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff5514ac-9add-44ac-b53d-5ee0e394b682 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.e67e530c-2097-4c5f-a884-c843a2fc5eb4" returned: 0 in 0.764s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:19 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-fbc7f8d3-a8d6-46b6-b1f2-4d4964abb279 tempest-ProjectMemberTests-1160045297 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.e67e530c-2097-4c5f-a884-c843a2fc5eb4 is being set with open permissions: ugo+rw Jul 07 17:43:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fbc7f8d3-a8d6-46b6-b1f2-4d4964abb279 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.e67e530c-2097-4c5f-a884-c843a2fc5eb4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:19 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.e67e530c-2097-4c5f-a884-c843a2fc5eb4 Jul 07 17:43:19 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:20 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d155f531-74b4-4e4c-9c20-142d2a0cf53c tempest-ProjectReaderTests-1690191251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c" returned: 0 in 0.808s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d155f531-74b4-4e4c-9c20-142d2a0cf53c tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:20 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c Jul 07 17:43:20 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:20 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fbc7f8d3-a8d6-46b6-b1f2-4d4964abb279 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.e67e530c-2097-4c5f-a884-c843a2fc5eb4" returned: 0 in 0.713s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fbc7f8d3-a8d6-46b6-b1f2-4d4964abb279 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:20 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.info Jul 07 17:43:20 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:20 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d155f531-74b4-4e4c-9c20-142d2a0cf53c tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-6d4c9340-5de0-4f49-b1fc-53e455de133c" returned: 0 in 0.666s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:20 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d155f531-74b4-4e4c-9c20-142d2a0cf53c tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-6d4c9340-5de0-4f49-b1fc-53e455de133c" released by "delete_volume" :: held 1.553s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:21 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-d155f531-74b4-4e4c-9c20-142d2a0cf53c tempest-ProjectReaderTests-1690191251 None] Created reservations ['23e2f50f-2bb2-4acd-b60e-714ab8f5baa4', '478744fd-e611-4be0-9ccd-dcb78e4e7985', '64178d24-08ff-43cd-b52e-d6592cdc8db0', '01150320-82e7-4f39-8d1d-0b2303b3d935'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d155f531-74b4-4e4c-9c20-142d2a0cf53c tempest-ProjectReaderTests-1690191251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d155f531-74b4-4e4c-9c20-142d2a0cf53c tempest-ProjectReaderTests-1690191251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d155f531-74b4-4e4c-9c20-142d2a0cf53c tempest-ProjectReaderTests-1690191251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d155f531-74b4-4e4c-9c20-142d2a0cf53c tempest-ProjectReaderTests-1690191251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d155f531-74b4-4e4c-9c20-142d2a0cf53c tempest-ProjectReaderTests-1690191251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d155f531-74b4-4e4c-9c20-142d2a0cf53c tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:21 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:43:21 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:21 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fbc7f8d3-a8d6-46b6-b1f2-4d4964abb279 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.info" returned: 0 in 0.773s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:21 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-fbc7f8d3-a8d6-46b6-b1f2-4d4964abb279 tempest-ProjectMemberTests-1160045297 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.info is being set with open permissions: ugo+rw Jul 07 17:43:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fbc7f8d3-a8d6-46b6-b1f2-4d4964abb279 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:21 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.info Jul 07 17:43:21 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:21 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d155f531-74b4-4e4c-9c20-142d2a0cf53c tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.790s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:21 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-d155f531-74b4-4e4c-9c20-142d2a0cf53c tempest-ProjectReaderTests-1690191251 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:21 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-d155f531-74b4-4e4c-9c20-142d2a0cf53c tempest-ProjectReaderTests-1690191251 None] Deleted volume successfully. Jul 07 17:43:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-d155f531-74b4-4e4c-9c20-142d2a0cf53c tempest-ProjectReaderTests-1690191251 None] Lock "cinder-6d4c9340-5de0-4f49-b1fc-53e455de133c-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:22 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-fbc7f8d3-a8d6-46b6-b1f2-4d4964abb279 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.info" returned: 0 in 0.782s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-fbc7f8d3-a8d6-46b6-b1f2-4d4964abb279 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.920s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Flow 'volume_create_manager' (662654eb-18ce-4bc2-a80f-605d6e727206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22791a96-93b1-4bdc-b659-6e5aa1442d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22791a96-93b1-4bdc-b659-6e5aa1442d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-684528238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a431f5f8-8b90-4b53-a25e-63d0acc7bd0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ac77c0e4184ec79759fdc2759452f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:22Z,use_quota=True,user_id='432b342bf7cf42968fe570ca1f4ae255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec4b1e1-231b-48ab-acf3-435bf6e95efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec4b1e1-231b-48ab-acf3-435bf6e95efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff2b114-ec22-4666-84b2-93fa456edaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff2b114-ec22-4666-84b2-93fa456edaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a431f5f8-8b90-4b53-a25e-63d0acc7bd0c', 'volume_name': 'volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5efabcf8-2897-4c8c-b861-1c28034ce706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5efabcf8-2897-4c8c-b861-1c28034ce706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ac23a9-c2a2-476c-8630-b7add4e83cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:22 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Volume a431f5f8-8b90-4b53-a25e-63d0acc7bd0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c', 'volume_size': 1} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-684528238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a431f5f8-8b90-4b53-a25e-63d0acc7bd0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ac77c0e4184ec79759fdc2759452f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:22Z,use_quota=True,user_id='432b342bf7cf42968fe570ca1f4ae255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Creating volume a431f5f8-8b90-4b53-a25e-63d0acc7bd0c {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:22 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:22 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-fbc7f8d3-a8d6-46b6-b1f2-4d4964abb279 tempest-ProjectMemberTests-1160045297 None] Create snapshot completed successfully Jul 07 17:43:22 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c 1073741824 Jul 07 17:43:22 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6cdb5a51-6b2d-4e7f-9fc5-9bfe97ff4732 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-e67e530c-2097-4c5f-a884-c843a2fc5eb4-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6cdb5a51-6b2d-4e7f-9fc5-9bfe97ff4732 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-e67e530c-2097-4c5f-a884-c843a2fc5eb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6cdb5a51-6b2d-4e7f-9fc5-9bfe97ff4732 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-ff5514ac-9add-44ac-b53d-5ee0e394b682" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6cdb5a51-6b2d-4e7f-9fc5-9bfe97ff4732 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-ff5514ac-9add-44ac-b53d-5ee0e394b682" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6cdb5a51-6b2d-4e7f-9fc5-9bfe97ff4732 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-e67e530c-2097-4c5f-a884-c843a2fc5eb4" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6cdb5a51-6b2d-4e7f-9fc5-9bfe97ff4732 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-e67e530c-2097-4c5f-a884-c843a2fc5eb4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-6cdb5a51-6b2d-4e7f-9fc5-9bfe97ff4732 tempest-ProjectMemberTests-1160045297 None] Deleting offline snapshot e67e530c-2097-4c5f-a884-c843a2fc5eb4 of volume ff5514ac-9add-44ac-b53d-5ee0e394b682 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-6cdb5a51-6b2d-4e7f-9fc5-9bfe97ff4732 tempest-ProjectMemberTests-1160045297 None] snapshot_file for this snap is: volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.e67e530c-2097-4c5f-a884-c843a2fc5eb4 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc9830d-29ba-46df-a2f6-2320ed40e842]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6cdb5a51-6b2d-4e7f-9fc5-9bfe97ff4732 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.e67e530c-2097-4c5f-a884-c843a2fc5eb4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:22 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.e67e530c-2097-4c5f-a884-c843a2fc5eb4 Jul 07 17:43:22 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:23 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c 1073741824" returned: 0 in 1.010s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:23 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c Jul 07 17:43:23 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:23 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6cdb5a51-6b2d-4e7f-9fc5-9bfe97ff4732 tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.e67e530c-2097-4c5f-a884-c843a2fc5eb4" returned: 0 in 0.897s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:23 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-6cdb5a51-6b2d-4e7f-9fc5-9bfe97ff4732 tempest-ProjectMemberTests-1160045297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff5514ac-9add-44ac-b53d-5ee0e394b682(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:43:23 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a1fe3c-edfb-4636-a4ab-6e03b199830b]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6cdb5a51-6b2d-4e7f-9fc5-9bfe97ff4732 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:23 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682 Jul 07 17:43:23 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:24 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c" returned: 0 in 0.820s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:24 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ac23a9-c2a2-476c-8630-b7add4e83cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d59f2416-5d30-462c-b1fe-133a03473928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:24 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Volume volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c (a431f5f8-8b90-4b53-a25e-63d0acc7bd0c): created successfully Jul 07 17:43:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d59f2416-5d30-462c-b1fe-133a03473928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:24 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Flow 'volume_create_manager' (662654eb-18ce-4bc2-a80f-605d6e727206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:24 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-dede158e-43e4-4d7d-b5c4-78aa1faa3200 tempest-ProjectReaderTests-1690191251 None] Created volume successfully. Jul 07 17:43:24 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6cdb5a51-6b2d-4e7f-9fc5-9bfe97ff4732 tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682" returned: 0 in 0.902s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6cdb5a51-6b2d-4e7f-9fc5-9bfe97ff4732 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.e67e530c-2097-4c5f-a884-c843a2fc5eb4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:24 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.e67e530c-2097-4c5f-a884-c843a2fc5eb4 Jul 07 17:43:24 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:25 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6cdb5a51-6b2d-4e7f-9fc5-9bfe97ff4732 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.e67e530c-2097-4c5f-a884-c843a2fc5eb4" returned: 0 in 0.889s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6cdb5a51-6b2d-4e7f-9fc5-9bfe97ff4732 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.e67e530c-2097-4c5f-a884-c843a2fc5eb4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:25 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.e67e530c-2097-4c5f-a884-c843a2fc5eb4 Jul 07 17:43:25 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6dabba2b-545d-4e08-af41-b56537b60102 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6dabba2b-545d-4e08-af41-b56537b60102 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:25 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-6dabba2b-545d-4e08-af41-b56537b60102 tempest-ProjectReaderTests-1690191251 None] Creating offline snapshot 2456006d-15c0-4634-b9e2-100884106148 of volume a431f5f8-8b90-4b53-a25e-63d0acc7bd0c {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:43:25 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c98007-476d-4d90-8a83-f22e77b75ddc]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6dabba2b-545d-4e08-af41-b56537b60102 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:25 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c Jul 07 17:43:25 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:26 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6cdb5a51-6b2d-4e7f-9fc5-9bfe97ff4732 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682.e67e530c-2097-4c5f-a884-c843a2fc5eb4" returned: 0 in 0.768s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6cdb5a51-6b2d-4e7f-9fc5-9bfe97ff4732 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-e67e530c-2097-4c5f-a884-c843a2fc5eb4" released by "_delete_snapshot" :: held 3.596s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6cdb5a51-6b2d-4e7f-9fc5-9bfe97ff4732 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-ff5514ac-9add-44ac-b53d-5ee0e394b682" released by "delete_snapshot" :: held 3.632s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:26 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-6cdb5a51-6b2d-4e7f-9fc5-9bfe97ff4732 tempest-ProjectMemberTests-1160045297 None] Created reservations ['b0118774-845b-46c8-a726-df9d9ec755d5', 'e99b0060-7a00-4702-93d1-56b715d1c6fe', '82f220f1-9a98-42a4-be7a-00ff066d6c49', '634c1f3f-db18-4197-85ff-d992db966b49'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:26 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-6cdb5a51-6b2d-4e7f-9fc5-9bfe97ff4732 tempest-ProjectMemberTests-1160045297 None] Delete snapshot completed successfully. Jul 07 17:43:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-6cdb5a51-6b2d-4e7f-9fc5-9bfe97ff4732 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-e67e530c-2097-4c5f-a884-c843a2fc5eb4-delete_snapshot" released by "delete_snapshot" :: held 3.796s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:26 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6dabba2b-545d-4e08-af41-b56537b60102 tempest-ProjectReaderTests-1690191251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c" returned: 0 in 0.913s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6dabba2b-545d-4e08-af41-b56537b60102 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.2456006d-15c0-4634-b9e2-100884106148 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:26 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.2456006d-15c0-4634-b9e2-100884106148 1G Jul 07 17:43:26 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-85f2a480-984b-44df-af73-5ff84da5051d tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-ff5514ac-9add-44ac-b53d-5ee0e394b682-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-85f2a480-984b-44df-af73-5ff84da5051d tempest-ProjectMemberTests-1160045297 None] Lock "cinder-ff5514ac-9add-44ac-b53d-5ee0e394b682-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-85f2a480-984b-44df-af73-5ff84da5051d tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-ff5514ac-9add-44ac-b53d-5ee0e394b682" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:26 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-85f2a480-984b-44df-af73-5ff84da5051d tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-ff5514ac-9add-44ac-b53d-5ee0e394b682" acquired by "delete_volume" :: waited 0.024s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:26 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb42bc07-b4b4-476f-a356-879dd1952cf2]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-85f2a480-984b-44df-af73-5ff84da5051d tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:27 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682 Jul 07 17:43:27 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:27 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6dabba2b-545d-4e08-af41-b56537b60102 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.2456006d-15c0-4634-b9e2-100884106148 1G" returned: 0 in 1.023s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6dabba2b-545d-4e08-af41-b56537b60102 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.2456006d-15c0-4634-b9e2-100884106148 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:27 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.2456006d-15c0-4634-b9e2-100884106148 Jul 07 17:43:27 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:27 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-85f2a480-984b-44df-af73-5ff84da5051d tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682" returned: 0 in 0.838s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-85f2a480-984b-44df-af73-5ff84da5051d tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:27 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682 Jul 07 17:43:27 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:28 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6dabba2b-545d-4e08-af41-b56537b60102 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.2456006d-15c0-4634-b9e2-100884106148" returned: 0 in 0.777s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:28 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-6dabba2b-545d-4e08-af41-b56537b60102 tempest-ProjectReaderTests-1690191251 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.2456006d-15c0-4634-b9e2-100884106148 is being set with open permissions: ugo+rw Jul 07 17:43:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6dabba2b-545d-4e08-af41-b56537b60102 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.2456006d-15c0-4634-b9e2-100884106148 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:28 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.2456006d-15c0-4634-b9e2-100884106148 Jul 07 17:43:28 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:28 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-85f2a480-984b-44df-af73-5ff84da5051d tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ff5514ac-9add-44ac-b53d-5ee0e394b682" returned: 0 in 0.744s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-85f2a480-984b-44df-af73-5ff84da5051d tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-ff5514ac-9add-44ac-b53d-5ee0e394b682" released by "delete_volume" :: held 1.658s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:28 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-85f2a480-984b-44df-af73-5ff84da5051d tempest-ProjectMemberTests-1160045297 None] Created reservations ['7908c017-1d7b-4f77-aa47-26a58b978819', 'ef046cda-469b-41db-9767-88a65181fbdd', 'e9c6d980-a7c4-46f5-a832-cf58ab17abe2', 'c862cf47-82e4-4ce5-9aff-275669cb175b'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-85f2a480-984b-44df-af73-5ff84da5051d tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-85f2a480-984b-44df-af73-5ff84da5051d tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-85f2a480-984b-44df-af73-5ff84da5051d tempest-ProjectMemberTests-1160045297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-85f2a480-984b-44df-af73-5ff84da5051d tempest-ProjectMemberTests-1160045297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-85f2a480-984b-44df-af73-5ff84da5051d tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-85f2a480-984b-44df-af73-5ff84da5051d tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:28 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:43:28 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:28 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6dabba2b-545d-4e08-af41-b56537b60102 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.2456006d-15c0-4634-b9e2-100884106148" returned: 0 in 0.697s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6dabba2b-545d-4e08-af41-b56537b60102 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:29 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.info Jul 07 17:43:29 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:29 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-85f2a480-984b-44df-af73-5ff84da5051d tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.745s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:29 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-85f2a480-984b-44df-af73-5ff84da5051d tempest-ProjectMemberTests-1160045297 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:29 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-85f2a480-984b-44df-af73-5ff84da5051d tempest-ProjectMemberTests-1160045297 None] Deleted volume successfully. Jul 07 17:43:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-85f2a480-984b-44df-af73-5ff84da5051d tempest-ProjectMemberTests-1160045297 None] Lock "cinder-ff5514ac-9add-44ac-b53d-5ee0e394b682-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:29 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Flow 'volume_create_manager' (b5e1983e-4ae5-4d3a-afab-811346167e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72bae5b4-5c43-4902-a781-fedba006bf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72bae5b4-5c43-4902-a781-fedba006bf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1129006105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0b58d71fa140d991a236c4f4eef6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:29Z,use_quota=True,user_id='11c2377e77ba472e95fe61cd6ab8ed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42dbb0b-b4ea-4283-8903-194150323f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42dbb0b-b4ea-4283-8903-194150323f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ede86d2-d4d3-4087-b795-c1aac61fdccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ede86d2-d4d3-4087-b795-c1aac61fdccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2', 'volume_name': 'volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7b41f8-4822-4f46-87d5-da6171b0d7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7b41f8-4822-4f46-87d5-da6171b0d7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (636a38a3-0388-4ad9-bd46-8468d9ad3c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:29 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Volume e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2', 'volume_size': 1} Jul 07 17:43:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:29 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6dabba2b-545d-4e08-af41-b56537b60102 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.info" returned: 0 in 0.716s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:29 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-6dabba2b-545d-4e08-af41-b56537b60102 tempest-ProjectReaderTests-1690191251 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.info is being set with open permissions: ugo+rw Jul 07 17:43:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6dabba2b-545d-4e08-af41-b56537b60102 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:29 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.info Jul 07 17:43:29 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:30 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6dabba2b-545d-4e08-af41-b56537b60102 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.info" returned: 0 in 0.650s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6dabba2b-545d-4e08-af41-b56537b60102 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.874s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.793s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1129006105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0b58d71fa140d991a236c4f4eef6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:29Z,use_quota=True,user_id='11c2377e77ba472e95fe61cd6ab8ed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Creating volume e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:30 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:43:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:30 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2 1073741824 Jul 07 17:43:30 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:30 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-6dabba2b-545d-4e08-af41-b56537b60102 tempest-ProjectReaderTests-1690191251 None] Create snapshot completed successfully Jul 07 17:43:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dd5cea65-90e6-44d2-8b50-06a547c86ea8 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-2456006d-15c0-4634-b9e2-100884106148-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dd5cea65-90e6-44d2-8b50-06a547c86ea8 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-2456006d-15c0-4634-b9e2-100884106148-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dd5cea65-90e6-44d2-8b50-06a547c86ea8 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-quobyte-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dd5cea65-90e6-44d2-8b50-06a547c86ea8 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dd5cea65-90e6-44d2-8b50-06a547c86ea8 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-quobyte-2456006d-15c0-4634-b9e2-100884106148" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:30 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dd5cea65-90e6-44d2-8b50-06a547c86ea8 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-2456006d-15c0-4634-b9e2-100884106148" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-dd5cea65-90e6-44d2-8b50-06a547c86ea8 tempest-ProjectReaderTests-1690191251 None] Deleting offline snapshot 2456006d-15c0-4634-b9e2-100884106148 of volume a431f5f8-8b90-4b53-a25e-63d0acc7bd0c {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:43:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-dd5cea65-90e6-44d2-8b50-06a547c86ea8 tempest-ProjectReaderTests-1690191251 None] snapshot_file for this snap is: volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.2456006d-15c0-4634-b9e2-100884106148 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:43:30 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb38a66-9465-44a7-91d1-98ae24f0229b]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dd5cea65-90e6-44d2-8b50-06a547c86ea8 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.2456006d-15c0-4634-b9e2-100884106148 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:31 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.2456006d-15c0-4634-b9e2-100884106148 Jul 07 17:43:31 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:31 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2 1073741824" returned: 0 in 0.923s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:31 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2 Jul 07 17:43:31 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:31 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dd5cea65-90e6-44d2-8b50-06a547c86ea8 tempest-ProjectReaderTests-1690191251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.2456006d-15c0-4634-b9e2-100884106148" returned: 0 in 0.838s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:31 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-dd5cea65-90e6-44d2-8b50-06a547c86ea8 tempest-ProjectReaderTests-1690191251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:43:31 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a6f1ae-f1df-4183-a0ab-19463108e1b6]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dd5cea65-90e6-44d2-8b50-06a547c86ea8 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:31 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c Jul 07 17:43:31 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:32 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2" returned: 0 in 0.672s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (636a38a3-0388-4ad9-bd46-8468d9ad3c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e335b0cd-e157-42b5-a7d1-847c1267bea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:32 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Volume volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2 (e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2): created successfully Jul 07 17:43:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e335b0cd-e157-42b5-a7d1-847c1267bea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:32 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Flow 'volume_create_manager' (b5e1983e-4ae5-4d3a-afab-811346167e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:32 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-4ab8ec4a-3064-4646-ab23-bfc3f16f2096 tempest-ProjectMemberTests-1160045297 None] Created volume successfully. Jul 07 17:43:32 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dd5cea65-90e6-44d2-8b50-06a547c86ea8 tempest-ProjectReaderTests-1690191251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c" returned: 0 in 0.772s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dd5cea65-90e6-44d2-8b50-06a547c86ea8 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.2456006d-15c0-4634-b9e2-100884106148 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:32 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.2456006d-15c0-4634-b9e2-100884106148 Jul 07 17:43:32 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d47e9db7-d78c-48ec-a3d9-bf8d6a226912 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d47e9db7-d78c-48ec-a3d9-bf8d6a226912 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:32 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-d47e9db7-d78c-48ec-a3d9-bf8d6a226912 tempest-ProjectMemberTests-1160045297 None] Creating offline snapshot 1bce9634-35da-412a-8a02-9164b3c73999 of volume e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:43:32 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ab0ba8-31f0-4785-9ba7-cc6e21a87fa6]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d47e9db7-d78c-48ec-a3d9-bf8d6a226912 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:33 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2 Jul 07 17:43:33 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:33 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dd5cea65-90e6-44d2-8b50-06a547c86ea8 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.2456006d-15c0-4634-b9e2-100884106148" returned: 0 in 0.813s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dd5cea65-90e6-44d2-8b50-06a547c86ea8 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.2456006d-15c0-4634-b9e2-100884106148 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:33 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.2456006d-15c0-4634-b9e2-100884106148 Jul 07 17:43:33 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:33 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d47e9db7-d78c-48ec-a3d9-bf8d6a226912 tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2" returned: 0 in 0.778s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d47e9db7-d78c-48ec-a3d9-bf8d6a226912 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.1bce9634-35da-412a-8a02-9164b3c73999 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:33 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.1bce9634-35da-412a-8a02-9164b3c73999 1G Jul 07 17:43:33 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:34 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-dd5cea65-90e6-44d2-8b50-06a547c86ea8 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c.2456006d-15c0-4634-b9e2-100884106148" returned: 0 in 0.775s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dd5cea65-90e6-44d2-8b50-06a547c86ea8 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-2456006d-15c0-4634-b9e2-100884106148" released by "_delete_snapshot" :: held 3.302s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dd5cea65-90e6-44d2-8b50-06a547c86ea8 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c" released by "delete_snapshot" :: held 3.329s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:34 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-dd5cea65-90e6-44d2-8b50-06a547c86ea8 tempest-ProjectReaderTests-1690191251 None] Created reservations ['cb6d4b2a-8377-41bc-b5d3-1f182a28d77c', 'd5f2c43c-a5d9-4582-ad9a-a67929fa2090', '771768c4-f526-4a19-bcec-2f0f35f70ecc', '9196ab14-a004-450a-a4e7-996d09799e9f'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:34 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-dd5cea65-90e6-44d2-8b50-06a547c86ea8 tempest-ProjectReaderTests-1690191251 None] Delete snapshot completed successfully. Jul 07 17:43:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-dd5cea65-90e6-44d2-8b50-06a547c86ea8 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-2456006d-15c0-4634-b9e2-100884106148-delete_snapshot" released by "delete_snapshot" :: held 3.484s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:34 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d47e9db7-d78c-48ec-a3d9-bf8d6a226912 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.1bce9634-35da-412a-8a02-9164b3c73999 1G" returned: 0 in 0.877s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d47e9db7-d78c-48ec-a3d9-bf8d6a226912 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.1bce9634-35da-412a-8a02-9164b3c73999 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:34 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.1bce9634-35da-412a-8a02-9164b3c73999 Jul 07 17:43:34 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-3b444072-fa18-46ca-92dc-ec1edf85c0f9 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-3b444072-fa18-46ca-92dc-ec1edf85c0f9 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-3b444072-fa18-46ca-92dc-ec1edf85c0f9 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "cinder-quobyte-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-3b444072-fa18-46ca-92dc-ec1edf85c0f9 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c" acquired by "delete_volume" :: waited 0.013s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:35 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[73146d6d-b0e8-4fa3-a8e9-50cc37113ab3]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3b444072-fa18-46ca-92dc-ec1edf85c0f9 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:35 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c Jul 07 17:43:35 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:35 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d47e9db7-d78c-48ec-a3d9-bf8d6a226912 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.1bce9634-35da-412a-8a02-9164b3c73999" returned: 0 in 0.766s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:35 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-d47e9db7-d78c-48ec-a3d9-bf8d6a226912 tempest-ProjectMemberTests-1160045297 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.1bce9634-35da-412a-8a02-9164b3c73999 is being set with open permissions: ugo+rw Jul 07 17:43:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d47e9db7-d78c-48ec-a3d9-bf8d6a226912 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.1bce9634-35da-412a-8a02-9164b3c73999 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:35 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.1bce9634-35da-412a-8a02-9164b3c73999 Jul 07 17:43:35 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:36 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3b444072-fa18-46ca-92dc-ec1edf85c0f9 tempest-ProjectReaderTests-1690191251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c" returned: 0 in 0.821s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3b444072-fa18-46ca-92dc-ec1edf85c0f9 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:36 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d47e9db7-d78c-48ec-a3d9-bf8d6a226912 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.1bce9634-35da-412a-8a02-9164b3c73999" returned: 0 in 0.679s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:36 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c Jul 07 17:43:36 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d47e9db7-d78c-48ec-a3d9-bf8d6a226912 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:36 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.info Jul 07 17:43:36 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:36 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3b444072-fa18-46ca-92dc-ec1edf85c0f9 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c" returned: 0 in 0.679s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-3b444072-fa18-46ca-92dc-ec1edf85c0f9 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-quobyte-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c" released by "delete_volume" :: held 1.561s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:36 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d47e9db7-d78c-48ec-a3d9-bf8d6a226912 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.info" returned: 0 in 0.688s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:36 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-d47e9db7-d78c-48ec-a3d9-bf8d6a226912 tempest-ProjectMemberTests-1160045297 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.info is being set with open permissions: ugo+rw Jul 07 17:43:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d47e9db7-d78c-48ec-a3d9-bf8d6a226912 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:36 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.info Jul 07 17:43:36 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:36 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-3b444072-fa18-46ca-92dc-ec1edf85c0f9 tempest-ProjectReaderTests-1690191251 None] Created reservations ['a25bfedd-c04d-46e6-a24e-07f9f54b5fa7', '1c945784-4aa4-452c-9b22-81b472bd9699', '1d12d7d8-939c-4fbf-bbff-49c0f5832424', 'a1601ebf-6b3d-427e-887c-c9dd4e4c3fbc'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3b444072-fa18-46ca-92dc-ec1edf85c0f9 tempest-ProjectReaderTests-1690191251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3b444072-fa18-46ca-92dc-ec1edf85c0f9 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3b444072-fa18-46ca-92dc-ec1edf85c0f9 tempest-ProjectReaderTests-1690191251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3b444072-fa18-46ca-92dc-ec1edf85c0f9 tempest-ProjectReaderTests-1690191251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3b444072-fa18-46ca-92dc-ec1edf85c0f9 tempest-ProjectReaderTests-1690191251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3b444072-fa18-46ca-92dc-ec1edf85c0f9 tempest-ProjectReaderTests-1690191251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:36 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:43:36 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:37 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d47e9db7-d78c-48ec-a3d9-bf8d6a226912 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.info" returned: 0 in 0.694s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d47e9db7-d78c-48ec-a3d9-bf8d6a226912 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.587s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:37 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-d47e9db7-d78c-48ec-a3d9-bf8d6a226912 tempest-ProjectMemberTests-1160045297 None] Create snapshot completed successfully Jul 07 17:43:37 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3b444072-fa18-46ca-92dc-ec1edf85c0f9 tempest-ProjectReaderTests-1690191251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.735s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:37 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-3b444072-fa18-46ca-92dc-ec1edf85c0f9 tempest-ProjectReaderTests-1690191251 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:37 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-3b444072-fa18-46ca-92dc-ec1edf85c0f9 tempest-ProjectReaderTests-1690191251 None] Deleted volume successfully. Jul 07 17:43:37 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-3b444072-fa18-46ca-92dc-ec1edf85c0f9 tempest-ProjectReaderTests-1690191251 None] Lock "cinder-a431f5f8-8b90-4b53-a25e-63d0acc7bd0c-delete_volume" released by "delete_volume" :: held 2.536s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:38 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-499065fb-1d47-4db4-8fa7-2485fa5c6742 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-1bce9634-35da-412a-8a02-9164b3c73999-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:38 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-499065fb-1d47-4db4-8fa7-2485fa5c6742 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-1bce9634-35da-412a-8a02-9164b3c73999-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:38 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-499065fb-1d47-4db4-8fa7-2485fa5c6742 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:38 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-499065fb-1d47-4db4-8fa7-2485fa5c6742 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:38 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-499065fb-1d47-4db4-8fa7-2485fa5c6742 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-1bce9634-35da-412a-8a02-9164b3c73999" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:38 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-499065fb-1d47-4db4-8fa7-2485fa5c6742 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-1bce9634-35da-412a-8a02-9164b3c73999" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-499065fb-1d47-4db4-8fa7-2485fa5c6742 tempest-ProjectMemberTests-1160045297 None] Deleting offline snapshot 1bce9634-35da-412a-8a02-9164b3c73999 of volume e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:43:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-499065fb-1d47-4db4-8fa7-2485fa5c6742 tempest-ProjectMemberTests-1160045297 None] snapshot_file for this snap is: volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.1bce9634-35da-412a-8a02-9164b3c73999 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:43:38 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[2119a2a9-09e9-4fa5-9a95-0b7d5ffe4531]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-499065fb-1d47-4db4-8fa7-2485fa5c6742 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.1bce9634-35da-412a-8a02-9164b3c73999 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:38 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.1bce9634-35da-412a-8a02-9164b3c73999 Jul 07 17:43:38 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:39 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-499065fb-1d47-4db4-8fa7-2485fa5c6742 tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.1bce9634-35da-412a-8a02-9164b3c73999" returned: 0 in 0.830s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:39 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-499065fb-1d47-4db4-8fa7-2485fa5c6742 tempest-ProjectMemberTests-1160045297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:43:39 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97bbe20-7082-4d45-b9cd-61e78680d4dc]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-499065fb-1d47-4db4-8fa7-2485fa5c6742 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:39 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2 Jul 07 17:43:39 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:39 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-499065fb-1d47-4db4-8fa7-2485fa5c6742 tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2" returned: 0 in 0.775s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-499065fb-1d47-4db4-8fa7-2485fa5c6742 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.1bce9634-35da-412a-8a02-9164b3c73999 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:39 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.1bce9634-35da-412a-8a02-9164b3c73999 Jul 07 17:43:39 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:40 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-499065fb-1d47-4db4-8fa7-2485fa5c6742 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.1bce9634-35da-412a-8a02-9164b3c73999" returned: 0 in 0.928s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-499065fb-1d47-4db4-8fa7-2485fa5c6742 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.1bce9634-35da-412a-8a02-9164b3c73999 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:40 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.1bce9634-35da-412a-8a02-9164b3c73999 Jul 07 17:43:40 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:41 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-499065fb-1d47-4db4-8fa7-2485fa5c6742 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2.1bce9634-35da-412a-8a02-9164b3c73999" returned: 0 in 0.908s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:41 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-499065fb-1d47-4db4-8fa7-2485fa5c6742 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-1bce9634-35da-412a-8a02-9164b3c73999" released by "_delete_snapshot" :: held 3.549s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:41 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-499065fb-1d47-4db4-8fa7-2485fa5c6742 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2" released by "delete_snapshot" :: held 3.576s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:41 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-499065fb-1d47-4db4-8fa7-2485fa5c6742 tempest-ProjectMemberTests-1160045297 None] Created reservations ['1f3be6ba-eb85-4524-ba03-cae55a6d1af7', '3fa22933-c8a6-4ee0-8615-0d3ee9a8389e', '091cbda6-a48e-441a-951b-27bb1a29d2cf', 'abfb8040-5950-4b8d-8301-7169b6494b54'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:41 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-499065fb-1d47-4db4-8fa7-2485fa5c6742 tempest-ProjectMemberTests-1160045297 None] Delete snapshot completed successfully. Jul 07 17:43:41 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-499065fb-1d47-4db4-8fa7-2485fa5c6742 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-1bce9634-35da-412a-8a02-9164b3c73999-delete_snapshot" released by "delete_snapshot" :: held 3.733s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:42 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-07767bed-b29b-48ee-918a-4877b160a7f1 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:42 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-07767bed-b29b-48ee-918a-4877b160a7f1 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:42 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-07767bed-b29b-48ee-918a-4877b160a7f1 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:42 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-07767bed-b29b-48ee-918a-4877b160a7f1 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2" acquired by "delete_volume" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:42 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[431b52df-a075-4ef4-b47e-b60bb11f9cf0]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-07767bed-b29b-48ee-918a-4877b160a7f1 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:42 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2 Jul 07 17:43:42 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:43 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-07767bed-b29b-48ee-918a-4877b160a7f1 tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2" returned: 0 in 0.967s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-07767bed-b29b-48ee-918a-4877b160a7f1 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:43 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2 Jul 07 17:43:43 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:44 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-07767bed-b29b-48ee-918a-4877b160a7f1 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2" returned: 0 in 0.732s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:44 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-07767bed-b29b-48ee-918a-4877b160a7f1 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2" released by "delete_volume" :: held 1.775s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:44 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-07767bed-b29b-48ee-918a-4877b160a7f1 tempest-ProjectMemberTests-1160045297 None] Created reservations ['cee5ffa0-1626-4186-83ba-71fde067c924', 'bf42e3be-b476-4b1e-a3c2-46ec71a9c0eb', '60e1220a-9973-4268-b08d-701d58a6f1f2', '407ffaf5-6cbc-476e-9fc9-409eff42a08f'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-07767bed-b29b-48ee-918a-4877b160a7f1 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-07767bed-b29b-48ee-918a-4877b160a7f1 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-07767bed-b29b-48ee-918a-4877b160a7f1 tempest-ProjectMemberTests-1160045297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-07767bed-b29b-48ee-918a-4877b160a7f1 tempest-ProjectMemberTests-1160045297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-07767bed-b29b-48ee-918a-4877b160a7f1 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-07767bed-b29b-48ee-918a-4877b160a7f1 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:44 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:43:44 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Flow 'volume_create_manager' (a16ce988-f022-4500-87dd-e251b36cb630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7fdb635-482c-45c7-9c3c-276eeb1344c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:45 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-07767bed-b29b-48ee-918a-4877b160a7f1 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.840s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-07767bed-b29b-48ee-918a-4877b160a7f1 tempest-ProjectMemberTests-1160045297 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7fdb635-482c-45c7-9c3c-276eeb1344c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-686721448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0b58d71fa140d991a236c4f4eef6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:45Z,use_quota=True,user_id='11c2377e77ba472e95fe61cd6ab8ed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f73a81c1-a346-4327-84ed-48311ea2ab88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f73a81c1-a346-4327-84ed-48311ea2ab88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5832546-157c-4ab7-802a-41a4c4a7eba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5832546-157c-4ab7-802a-41a4c4a7eba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74', 'volume_name': 'volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5ace35-bd4e-425d-8117-72408c7bb350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5ace35-bd4e-425d-8117-72408c7bb350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70cee303-2757-4048-a9fe-2a9973776579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:45 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Volume a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74', 'volume_size': 1} Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-686721448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0b58d71fa140d991a236c4f4eef6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:43:45Z,use_quota=True,user_id='11c2377e77ba472e95fe61cd6ab8ed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Creating volume a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:43:45 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:45 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-07767bed-b29b-48ee-918a-4877b160a7f1 tempest-ProjectMemberTests-1160045297 None] Deleted volume successfully. Jul 07 17:43:45 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74 1073741824 Jul 07 17:43:45 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:45 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-07767bed-b29b-48ee-918a-4877b160a7f1 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-e99fd322-7d2f-40e6-96b9-01f5a8d6a5a2-delete_volume" released by "delete_volume" :: held 3.042s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:46 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74 1073741824" returned: 0 in 1.110s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:46 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74 Jul 07 17:43:46 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:47 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74" returned: 0 in 0.723s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:47 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:43:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70cee303-2757-4048-a9fe-2a9973776579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (690b34c2-7d0e-48db-8877-47328b5cc33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:43:47 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Volume volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74 (a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74): created successfully Jul 07 17:43:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (690b34c2-7d0e-48db-8877-47328b5cc33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:43:47 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Flow 'volume_create_manager' (a16ce988-f022-4500-87dd-e251b36cb630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:43:47 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-78affe22-49f6-4c85-b442-9683ed02e681 tempest-ProjectMemberTests-1160045297 None] Created volume successfully. Jul 07 17:43:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f6af038f-3acb-4a9f-984e-d856778eaf7c tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f6af038f-3acb-4a9f-984e-d856778eaf7c tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:48 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-f6af038f-3acb-4a9f-984e-d856778eaf7c tempest-ProjectMemberTests-1160045297 None] Creating offline snapshot b58eb9dc-b97c-48b7-91fe-741e96385db8 of volume a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:43:48 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b64940-0ddd-42c9-94eb-91e409a401b1]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f6af038f-3acb-4a9f-984e-d856778eaf7c tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:48 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74 Jul 07 17:43:48 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:49 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f6af038f-3acb-4a9f-984e-d856778eaf7c tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74" returned: 0 in 0.914s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f6af038f-3acb-4a9f-984e-d856778eaf7c tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.b58eb9dc-b97c-48b7-91fe-741e96385db8 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:49 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.b58eb9dc-b97c-48b7-91fe-741e96385db8 1G Jul 07 17:43:49 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:50 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f6af038f-3acb-4a9f-984e-d856778eaf7c tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.b58eb9dc-b97c-48b7-91fe-741e96385db8 1G" returned: 0 in 1.078s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f6af038f-3acb-4a9f-984e-d856778eaf7c tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.b58eb9dc-b97c-48b7-91fe-741e96385db8 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:50 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.b58eb9dc-b97c-48b7-91fe-741e96385db8 Jul 07 17:43:50 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:51 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f6af038f-3acb-4a9f-984e-d856778eaf7c tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.b58eb9dc-b97c-48b7-91fe-741e96385db8" returned: 0 in 0.923s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:51 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-f6af038f-3acb-4a9f-984e-d856778eaf7c tempest-ProjectMemberTests-1160045297 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.b58eb9dc-b97c-48b7-91fe-741e96385db8 is being set with open permissions: ugo+rw Jul 07 17:43:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f6af038f-3acb-4a9f-984e-d856778eaf7c tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.b58eb9dc-b97c-48b7-91fe-741e96385db8 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:51 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.b58eb9dc-b97c-48b7-91fe-741e96385db8 Jul 07 17:43:51 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:52 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f6af038f-3acb-4a9f-984e-d856778eaf7c tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.b58eb9dc-b97c-48b7-91fe-741e96385db8" returned: 0 in 0.794s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f6af038f-3acb-4a9f-984e-d856778eaf7c tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:52 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.info Jul 07 17:43:52 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:53 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f6af038f-3acb-4a9f-984e-d856778eaf7c tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.info" returned: 0 in 0.769s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:53 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-f6af038f-3acb-4a9f-984e-d856778eaf7c tempest-ProjectMemberTests-1160045297 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.info is being set with open permissions: ugo+rw Jul 07 17:43:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f6af038f-3acb-4a9f-984e-d856778eaf7c tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:53 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.info Jul 07 17:43:53 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:53 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-f6af038f-3acb-4a9f-984e-d856778eaf7c tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.info" returned: 0 in 0.791s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-f6af038f-3acb-4a9f-984e-d856778eaf7c tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.389s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:54 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-f6af038f-3acb-4a9f-984e-d856778eaf7c tempest-ProjectMemberTests-1160045297 None] Create snapshot completed successfully Jul 07 17:43:54 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0e60036d-dfcb-4f25-927b-6af7d0cfb7b4 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-b58eb9dc-b97c-48b7-91fe-741e96385db8-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:54 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0e60036d-dfcb-4f25-927b-6af7d0cfb7b4 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-b58eb9dc-b97c-48b7-91fe-741e96385db8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:54 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0e60036d-dfcb-4f25-927b-6af7d0cfb7b4 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:54 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0e60036d-dfcb-4f25-927b-6af7d0cfb7b4 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:54 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0e60036d-dfcb-4f25-927b-6af7d0cfb7b4 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-b58eb9dc-b97c-48b7-91fe-741e96385db8" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:55 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0e60036d-dfcb-4f25-927b-6af7d0cfb7b4 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-b58eb9dc-b97c-48b7-91fe-741e96385db8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:55 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-0e60036d-dfcb-4f25-927b-6af7d0cfb7b4 tempest-ProjectMemberTests-1160045297 None] Deleting offline snapshot b58eb9dc-b97c-48b7-91fe-741e96385db8 of volume a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:43:55 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-0e60036d-dfcb-4f25-927b-6af7d0cfb7b4 tempest-ProjectMemberTests-1160045297 None] snapshot_file for this snap is: volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.b58eb9dc-b97c-48b7-91fe-741e96385db8 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:43:55 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[40957f4f-c7f9-4007-a23b-d11afe57603b]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0e60036d-dfcb-4f25-927b-6af7d0cfb7b4 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.b58eb9dc-b97c-48b7-91fe-741e96385db8 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:55 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.b58eb9dc-b97c-48b7-91fe-741e96385db8 Jul 07 17:43:55 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:55 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0e60036d-dfcb-4f25-927b-6af7d0cfb7b4 tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.b58eb9dc-b97c-48b7-91fe-741e96385db8" returned: 0 in 0.867s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:55 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-0e60036d-dfcb-4f25-927b-6af7d0cfb7b4 tempest-ProjectMemberTests-1160045297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:43:56 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[526341e2-9674-4499-b384-37e70edb197d]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0e60036d-dfcb-4f25-927b-6af7d0cfb7b4 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:56 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74 Jul 07 17:43:56 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:43:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:43:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:43:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:43:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:43:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:43:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:56 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:43:56 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:56 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0e60036d-dfcb-4f25-927b-6af7d0cfb7b4 tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74" returned: 0 in 0.907s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0e60036d-dfcb-4f25-927b-6af7d0cfb7b4 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.b58eb9dc-b97c-48b7-91fe-741e96385db8 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:56 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.b58eb9dc-b97c-48b7-91fe-741e96385db8 Jul 07 17:43:56 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:57 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.831s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:43:57 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:43:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:43:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:43:57 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0e60036d-dfcb-4f25-927b-6af7d0cfb7b4 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.b58eb9dc-b97c-48b7-91fe-741e96385db8" returned: 0 in 0.897s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0e60036d-dfcb-4f25-927b-6af7d0cfb7b4 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.b58eb9dc-b97c-48b7-91fe-741e96385db8 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:57 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.b58eb9dc-b97c-48b7-91fe-741e96385db8 Jul 07 17:43:57 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:43:58 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Jul 07 17:43:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0e60036d-dfcb-4f25-927b-6af7d0cfb7b4 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74.b58eb9dc-b97c-48b7-91fe-741e96385db8" returned: 0 in 0.859s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:43:58 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0e60036d-dfcb-4f25-927b-6af7d0cfb7b4 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-b58eb9dc-b97c-48b7-91fe-741e96385db8" released by "_delete_snapshot" :: held 3.721s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:58 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0e60036d-dfcb-4f25-927b-6af7d0cfb7b4 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74" released by "delete_snapshot" :: held 3.749s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:58 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-0e60036d-dfcb-4f25-927b-6af7d0cfb7b4 tempest-ProjectMemberTests-1160045297 None] Created reservations ['b865a245-8c9d-4d5f-ab17-bbf39cca1e01', 'e7e28ae2-3f7a-4461-85af-a52a32d4f8fe', 'aed6b788-cc71-4530-bac5-40fa8ec8b870', 'a9414187-c333-40e1-ad45-a42a5db5f32b'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:43:58 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-0e60036d-dfcb-4f25-927b-6af7d0cfb7b4 tempest-ProjectMemberTests-1160045297 None] Delete snapshot completed successfully. Jul 07 17:43:58 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0e60036d-dfcb-4f25-927b-6af7d0cfb7b4 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-b58eb9dc-b97c-48b7-91fe-741e96385db8-delete_snapshot" released by "delete_snapshot" :: held 3.973s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:43:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5c7173ac-27f4-41e0-94d4-6b26d6a5bb1a tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5c7173ac-27f4-41e0-94d4-6b26d6a5bb1a tempest-ProjectMemberTests-1160045297 None] Lock "cinder-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5c7173ac-27f4-41e0-94d4-6b26d6a5bb1a tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:43:59 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5c7173ac-27f4-41e0-94d4-6b26d6a5bb1a tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74" acquired by "delete_volume" :: waited 0.023s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:43:59 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5ce014-b02e-4de1-abb7-7388e68a34e1]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:43:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5c7173ac-27f4-41e0-94d4-6b26d6a5bb1a tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:43:59 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74 Jul 07 17:43:59 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:00 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5c7173ac-27f4-41e0-94d4-6b26d6a5bb1a tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74" returned: 0 in 0.861s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5c7173ac-27f4-41e0-94d4-6b26d6a5bb1a tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:00 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74 Jul 07 17:44:00 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:01 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5c7173ac-27f4-41e0-94d4-6b26d6a5bb1a tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74" returned: 0 in 0.737s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:01 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5c7173ac-27f4-41e0-94d4-6b26d6a5bb1a tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74" released by "delete_volume" :: held 1.678s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:01 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-5c7173ac-27f4-41e0-94d4-6b26d6a5bb1a tempest-ProjectMemberTests-1160045297 None] Created reservations ['050af657-77a6-4e68-a419-dc07646d9660', '0029ea65-8e0b-47c1-bf16-6a27c1490ea9', 'b25cb8dc-a88d-456e-93f1-135c1cfcceaa', 'df279b97-15d5-4f06-803d-4747941a8ed4'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5c7173ac-27f4-41e0-94d4-6b26d6a5bb1a tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5c7173ac-27f4-41e0-94d4-6b26d6a5bb1a tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5c7173ac-27f4-41e0-94d4-6b26d6a5bb1a tempest-ProjectMemberTests-1160045297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5c7173ac-27f4-41e0-94d4-6b26d6a5bb1a tempest-ProjectMemberTests-1160045297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5c7173ac-27f4-41e0-94d4-6b26d6a5bb1a tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5c7173ac-27f4-41e0-94d4-6b26d6a5bb1a tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:01 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:44:01 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:02 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5c7173ac-27f4-41e0-94d4-6b26d6a5bb1a tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.907s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-5c7173ac-27f4-41e0-94d4-6b26d6a5bb1a tempest-ProjectMemberTests-1160045297 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:02 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5c7173ac-27f4-41e0-94d4-6b26d6a5bb1a tempest-ProjectMemberTests-1160045297 None] Deleted volume successfully. Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=105,cinder:INSERT=38,cinder:UPDATE=127,cinder:DELETE=13 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-5c7173ac-27f4-41e0-94d4-6b26d6a5bb1a tempest-ProjectMemberTests-1160045297 None] Lock "cinder-a05d8ae3-9f8f-4545-a9e4-e8944ed5ff74-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=103,cinder:INSERT=37,cinder:UPDATE=140,cinder:DELETE=7 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Flow 'volume_create_manager' (34c0ca24-2bc0-4075-84c3-fdb3b0f3088d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84673d9a-742b-4f35-b017-c76ed254d6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84673d9a-742b-4f35-b017-c76ed254d6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1721189202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59018a04-6c34-477d-aa01-948c8bb32ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0b58d71fa140d991a236c4f4eef6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:02Z,use_quota=True,user_id='11c2377e77ba472e95fe61cd6ab8ed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ee9390-6072-488c-9c58-e293cc920cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ee9390-6072-488c-9c58-e293cc920cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (264b8f84-2ad1-481a-8758-e93c1e4ee33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (264b8f84-2ad1-481a-8758-e93c1e4ee33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59018a04-6c34-477d-aa01-948c8bb32ca3', 'volume_name': 'volume-59018a04-6c34-477d-aa01-948c8bb32ca3', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28f2b70-d76a-44e4-9899-7128945fc829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28f2b70-d76a-44e4-9899-7128945fc829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb75e759-4a71-4e5e-93a3-646517bed86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:02 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Volume 59018a04-6c34-477d-aa01-948c8bb32ca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59018a04-6c34-477d-aa01-948c8bb32ca3', 'volume_size': 1} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1721189202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59018a04-6c34-477d-aa01-948c8bb32ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0b58d71fa140d991a236c4f4eef6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:02Z,use_quota=True,user_id='11c2377e77ba472e95fe61cd6ab8ed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Creating volume 59018a04-6c34-477d-aa01-948c8bb32ca3 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:02 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:44:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:02 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3 1073741824 Jul 07 17:44:02 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:03 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3 1073741824" returned: 0 in 1.052s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:03 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3 Jul 07 17:44:03 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:04 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3" returned: 0 in 0.808s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:04 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:44:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb75e759-4a71-4e5e-93a3-646517bed86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59018a04-6c34-477d-aa01-948c8bb32ca3', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4320ebe3-8147-4e01-90a6-b3d7fb2fddfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:04 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Volume volume-59018a04-6c34-477d-aa01-948c8bb32ca3 (59018a04-6c34-477d-aa01-948c8bb32ca3): created successfully Jul 07 17:44:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4320ebe3-8147-4e01-90a6-b3d7fb2fddfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:04 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Flow 'volume_create_manager' (34c0ca24-2bc0-4075-84c3-fdb3b0f3088d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:04 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-c948b6a7-4db7-4018-9db3-9120bb716610 tempest-ProjectMemberTests-1160045297 None] Created volume successfully. Jul 07 17:44:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-08f26fb7-e21d-4bc3-9156-5a1f4092107f tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-08f26fb7-e21d-4bc3-9156-5a1f4092107f tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:05 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-08f26fb7-e21d-4bc3-9156-5a1f4092107f tempest-ProjectMemberTests-1160045297 None] Creating offline snapshot a2381c25-5a8c-45db-a975-7fd50a06c4f4 of volume 59018a04-6c34-477d-aa01-948c8bb32ca3 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:44:05 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f14362-bb4c-49d1-b407-1048fa64ee3d]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-08f26fb7-e21d-4bc3-9156-5a1f4092107f tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:05 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3 Jul 07 17:44:05 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:05 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:44:05 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Flow 'volume_create_manager' (14b9862c-953a-423a-891e-edcd340e628e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9d4c94-88fb-46b0-8fea-0fa97c42d7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9d4c94-88fb-46b0-8fea-0fa97c42d7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-119954524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974633b3-a2c6-4d94-9813-68b434acc848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16993691a68645f4b022354484184208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:06Z,use_quota=True,user_id='3159765875004cd896891e5126861851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2346bfce-48b0-40b9-acd2-ca179433f361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2346bfce-48b0-40b9-acd2-ca179433f361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429bf4c3-2a7c-447f-bd01-1d43444c57f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429bf4c3-2a7c-447f-bd01-1d43444c57f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '974633b3-a2c6-4d94-9813-68b434acc848', 'volume_name': 'volume-974633b3-a2c6-4d94-9813-68b434acc848', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab98acc-8de2-4d2c-869a-b9bbdf4bb9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab98acc-8de2-4d2c-869a-b9bbdf4bb9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:06 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdc1644-ae11-449e-9384-6a29d6b15f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:06 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Volume 974633b3-a2c6-4d94-9813-68b434acc848: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-974633b3-a2c6-4d94-9813-68b434acc848', 'volume_size': 1} Jul 07 17:44:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:06 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-08f26fb7-e21d-4bc3-9156-5a1f4092107f tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3" returned: 0 in 0.777s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-08f26fb7-e21d-4bc3-9156-5a1f4092107f tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.a2381c25-5a8c-45db-a975-7fd50a06c4f4 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:06 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.a2381c25-5a8c-45db-a975-7fd50a06c4f4 1G Jul 07 17:44:06 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:07 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-08f26fb7-e21d-4bc3-9156-5a1f4092107f tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.a2381c25-5a8c-45db-a975-7fd50a06c4f4 1G" returned: 0 in 0.814s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-08f26fb7-e21d-4bc3-9156-5a1f4092107f tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59018a04-6c34-477d-aa01-948c8bb32ca3 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.a2381c25-5a8c-45db-a975-7fd50a06c4f4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:07 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59018a04-6c34-477d-aa01-948c8bb32ca3 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.a2381c25-5a8c-45db-a975-7fd50a06c4f4 Jul 07 17:44:07 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:07 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-08f26fb7-e21d-4bc3-9156-5a1f4092107f tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59018a04-6c34-477d-aa01-948c8bb32ca3 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.a2381c25-5a8c-45db-a975-7fd50a06c4f4" returned: 0 in 0.707s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:07 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-08f26fb7-e21d-4bc3-9156-5a1f4092107f tempest-ProjectMemberTests-1160045297 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.a2381c25-5a8c-45db-a975-7fd50a06c4f4 is being set with open permissions: ugo+rw Jul 07 17:44:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-08f26fb7-e21d-4bc3-9156-5a1f4092107f tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.a2381c25-5a8c-45db-a975-7fd50a06c4f4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:07 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.a2381c25-5a8c-45db-a975-7fd50a06c4f4 Jul 07 17:44:07 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:08 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-08f26fb7-e21d-4bc3-9156-5a1f4092107f tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.a2381c25-5a8c-45db-a975-7fd50a06c4f4" returned: 0 in 0.755s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-08f26fb7-e21d-4bc3-9156-5a1f4092107f tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:08 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.info Jul 07 17:44:08 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:09 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-08f26fb7-e21d-4bc3-9156-5a1f4092107f tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.info" returned: 0 in 0.647s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:09 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-08f26fb7-e21d-4bc3-9156-5a1f4092107f tempest-ProjectMemberTests-1160045297 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.info is being set with open permissions: ugo+rw Jul 07 17:44:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-08f26fb7-e21d-4bc3-9156-5a1f4092107f tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:09 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.info Jul 07 17:44:09 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:09 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-08f26fb7-e21d-4bc3-9156-5a1f4092107f tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.info" returned: 0 in 0.676s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-08f26fb7-e21d-4bc3-9156-5a1f4092107f tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.473s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.936s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-119954524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974633b3-a2c6-4d94-9813-68b434acc848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16993691a68645f4b022354484184208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:06Z,use_quota=True,user_id='3159765875004cd896891e5126861851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Creating volume 974633b3-a2c6-4d94-9813-68b434acc848 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:10 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:44:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:10 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848 1073741824 Jul 07 17:44:10 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:10 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-08f26fb7-e21d-4bc3-9156-5a1f4092107f tempest-ProjectMemberTests-1160045297 None] Create snapshot completed successfully Jul 07 17:44:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0c75d620-dcdf-42a8-8264-f5a6dc7ad670 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-a2381c25-5a8c-45db-a975-7fd50a06c4f4-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0c75d620-dcdf-42a8-8264-f5a6dc7ad670 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-a2381c25-5a8c-45db-a975-7fd50a06c4f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0c75d620-dcdf-42a8-8264-f5a6dc7ad670 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-59018a04-6c34-477d-aa01-948c8bb32ca3" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0c75d620-dcdf-42a8-8264-f5a6dc7ad670 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-59018a04-6c34-477d-aa01-948c8bb32ca3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0c75d620-dcdf-42a8-8264-f5a6dc7ad670 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-a2381c25-5a8c-45db-a975-7fd50a06c4f4" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0c75d620-dcdf-42a8-8264-f5a6dc7ad670 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-a2381c25-5a8c-45db-a975-7fd50a06c4f4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-0c75d620-dcdf-42a8-8264-f5a6dc7ad670 tempest-ProjectMemberTests-1160045297 None] Deleting offline snapshot a2381c25-5a8c-45db-a975-7fd50a06c4f4 of volume 59018a04-6c34-477d-aa01-948c8bb32ca3 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:44:10 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-0c75d620-dcdf-42a8-8264-f5a6dc7ad670 tempest-ProjectMemberTests-1160045297 None] snapshot_file for this snap is: volume-59018a04-6c34-477d-aa01-948c8bb32ca3.a2381c25-5a8c-45db-a975-7fd50a06c4f4 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:44:10 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[4457638e-afba-4a18-a656-20c6427149cf]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0c75d620-dcdf-42a8-8264-f5a6dc7ad670 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.a2381c25-5a8c-45db-a975-7fd50a06c4f4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:10 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848 1073741824" returned: 0 in 0.976s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:10 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.a2381c25-5a8c-45db-a975-7fd50a06c4f4 Jul 07 17:44:10 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:11 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848 Jul 07 17:44:11 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:11 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0c75d620-dcdf-42a8-8264-f5a6dc7ad670 tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.a2381c25-5a8c-45db-a975-7fd50a06c4f4" returned: 0 in 0.831s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-0c75d620-dcdf-42a8-8264-f5a6dc7ad670 tempest-ProjectMemberTests-1160045297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59018a04-6c34-477d-aa01-948c8bb32ca3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:44:11 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848" returned: 0 in 0.707s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:11 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:44:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:11 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4b0f99-a214-4459-8758-edaef95ab585]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0c75d620-dcdf-42a8-8264-f5a6dc7ad670 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdc1644-ae11-449e-9384-6a29d6b15f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-974633b3-a2c6-4d94-9813-68b434acc848', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb58e4f-558e-4c1e-a4e4-5f5b95510521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:11 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Volume volume-974633b3-a2c6-4d94-9813-68b434acc848 (974633b3-a2c6-4d94-9813-68b434acc848): created successfully Jul 07 17:44:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb58e4f-558e-4c1e-a4e4-5f5b95510521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:11 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Flow 'volume_create_manager' (14b9862c-953a-423a-891e-edcd340e628e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:11 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-3eed54e0-ca5f-4de4-993e-f89e74da67e6 tempest-SnapshotDependencyTests-1241607320 None] Created volume successfully. Jul 07 17:44:11 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3 Jul 07 17:44:11 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:12 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0c75d620-dcdf-42a8-8264-f5a6dc7ad670 tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3" returned: 0 in 0.888s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0c75d620-dcdf-42a8-8264-f5a6dc7ad670 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.a2381c25-5a8c-45db-a975-7fd50a06c4f4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:12 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.a2381c25-5a8c-45db-a975-7fd50a06c4f4 Jul 07 17:44:12 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bdb4b156-0d64-4a7a-8403-f120130db841 tempest-SnapshotDependencyTests-1241607320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bdb4b156-0d64-4a7a-8403-f120130db841 tempest-SnapshotDependencyTests-1241607320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-bdb4b156-0d64-4a7a-8403-f120130db841 tempest-SnapshotDependencyTests-1241607320 None] Creating offline snapshot c1a6b7cc-1e67-454a-bbda-09a5a69f089b of volume 974633b3-a2c6-4d94-9813-68b434acc848 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:44:12 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[119c6913-910e-4a12-b9a6-6e8c887f9d14]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bdb4b156-0d64-4a7a-8403-f120130db841 tempest-SnapshotDependencyTests-1241607320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:12 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848 Jul 07 17:44:12 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:13 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bdb4b156-0d64-4a7a-8403-f120130db841 tempest-SnapshotDependencyTests-1241607320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848" returned: 0 in 0.837s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bdb4b156-0d64-4a7a-8403-f120130db841 tempest-SnapshotDependencyTests-1241607320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.c1a6b7cc-1e67-454a-bbda-09a5a69f089b 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:13 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.c1a6b7cc-1e67-454a-bbda-09a5a69f089b 1G Jul 07 17:44:13 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:13 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0c75d620-dcdf-42a8-8264-f5a6dc7ad670 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.a2381c25-5a8c-45db-a975-7fd50a06c4f4" returned: 0 in 0.999s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0c75d620-dcdf-42a8-8264-f5a6dc7ad670 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.a2381c25-5a8c-45db-a975-7fd50a06c4f4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:13 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.a2381c25-5a8c-45db-a975-7fd50a06c4f4 Jul 07 17:44:13 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:14 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-0c75d620-dcdf-42a8-8264-f5a6dc7ad670 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3.a2381c25-5a8c-45db-a975-7fd50a06c4f4" returned: 0 in 0.801s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:14 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bdb4b156-0d64-4a7a-8403-f120130db841 tempest-SnapshotDependencyTests-1241607320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.c1a6b7cc-1e67-454a-bbda-09a5a69f089b 1G" returned: 0 in 0.886s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bdb4b156-0d64-4a7a-8403-f120130db841 tempest-SnapshotDependencyTests-1241607320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-974633b3-a2c6-4d94-9813-68b434acc848 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.c1a6b7cc-1e67-454a-bbda-09a5a69f089b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:14 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0c75d620-dcdf-42a8-8264-f5a6dc7ad670 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-a2381c25-5a8c-45db-a975-7fd50a06c4f4" released by "_delete_snapshot" :: held 3.636s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:14 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0c75d620-dcdf-42a8-8264-f5a6dc7ad670 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-59018a04-6c34-477d-aa01-948c8bb32ca3" released by "delete_snapshot" :: held 3.667s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:14 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-974633b3-a2c6-4d94-9813-68b434acc848 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.c1a6b7cc-1e67-454a-bbda-09a5a69f089b Jul 07 17:44:14 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:14 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-0c75d620-dcdf-42a8-8264-f5a6dc7ad670 tempest-ProjectMemberTests-1160045297 None] Created reservations ['9fdbc190-e85c-43eb-b6a6-355ca81dd036', '25cd9a08-3d28-419e-91c8-c14e22782364', 'ba67432a-5153-4615-87fe-f8efdd13ef52', 'b260c52a-468f-4ac4-b29b-3f01ce2334c7'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:14 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-0c75d620-dcdf-42a8-8264-f5a6dc7ad670 tempest-ProjectMemberTests-1160045297 None] Delete snapshot completed successfully. Jul 07 17:44:14 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-0c75d620-dcdf-42a8-8264-f5a6dc7ad670 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-a2381c25-5a8c-45db-a975-7fd50a06c4f4-delete_snapshot" released by "delete_snapshot" :: held 3.823s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7f33ca55-a541-4e27-be34-359ad90a2f2d tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-59018a04-6c34-477d-aa01-948c8bb32ca3-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7f33ca55-a541-4e27-be34-359ad90a2f2d tempest-ProjectMemberTests-1160045297 None] Lock "cinder-59018a04-6c34-477d-aa01-948c8bb32ca3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7f33ca55-a541-4e27-be34-359ad90a2f2d tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-59018a04-6c34-477d-aa01-948c8bb32ca3" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:15 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7f33ca55-a541-4e27-be34-359ad90a2f2d tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-59018a04-6c34-477d-aa01-948c8bb32ca3" acquired by "delete_volume" :: waited 0.018s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:15 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7f7da8-1557-44cd-9ef5-cfb72f592569]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7f33ca55-a541-4e27-be34-359ad90a2f2d tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:15 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3 Jul 07 17:44:15 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:15 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bdb4b156-0d64-4a7a-8403-f120130db841 tempest-SnapshotDependencyTests-1241607320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-974633b3-a2c6-4d94-9813-68b434acc848 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.c1a6b7cc-1e67-454a-bbda-09a5a69f089b" returned: 0 in 0.871s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:15 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-bdb4b156-0d64-4a7a-8403-f120130db841 tempest-SnapshotDependencyTests-1241607320 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.c1a6b7cc-1e67-454a-bbda-09a5a69f089b is being set with open permissions: ugo+rw Jul 07 17:44:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bdb4b156-0d64-4a7a-8403-f120130db841 tempest-SnapshotDependencyTests-1241607320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.c1a6b7cc-1e67-454a-bbda-09a5a69f089b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:15 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.c1a6b7cc-1e67-454a-bbda-09a5a69f089b Jul 07 17:44:15 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:16 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7f33ca55-a541-4e27-be34-359ad90a2f2d tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3" returned: 0 in 0.846s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7f33ca55-a541-4e27-be34-359ad90a2f2d tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:16 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3 Jul 07 17:44:16 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:16 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bdb4b156-0d64-4a7a-8403-f120130db841 tempest-SnapshotDependencyTests-1241607320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.c1a6b7cc-1e67-454a-bbda-09a5a69f089b" returned: 0 in 0.806s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bdb4b156-0d64-4a7a-8403-f120130db841 tempest-SnapshotDependencyTests-1241607320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:16 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.info Jul 07 17:44:16 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:16 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7f33ca55-a541-4e27-be34-359ad90a2f2d tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-59018a04-6c34-477d-aa01-948c8bb32ca3" returned: 0 in 0.703s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:16 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7f33ca55-a541-4e27-be34-359ad90a2f2d tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-59018a04-6c34-477d-aa01-948c8bb32ca3" released by "delete_volume" :: held 1.617s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:16 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-7f33ca55-a541-4e27-be34-359ad90a2f2d tempest-ProjectMemberTests-1160045297 None] Created reservations ['256e8c8a-188c-4acd-82fc-0241a173fdb5', 'a02ea3be-ebd6-4391-b6d9-cd7b0e08ccc5', 'cb0c2633-144c-4a83-aa92-cea5bfb148dc', 'f4db692b-2094-4f08-9b82-ef7aefa7d304'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7f33ca55-a541-4e27-be34-359ad90a2f2d tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7f33ca55-a541-4e27-be34-359ad90a2f2d tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:16 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7f33ca55-a541-4e27-be34-359ad90a2f2d tempest-ProjectMemberTests-1160045297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:16 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-7f33ca55-a541-4e27-be34-359ad90a2f2d tempest-ProjectMemberTests-1160045297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-7f33ca55-a541-4e27-be34-359ad90a2f2d tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7f33ca55-a541-4e27-be34-359ad90a2f2d tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:16 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:44:16 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:17 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bdb4b156-0d64-4a7a-8403-f120130db841 tempest-SnapshotDependencyTests-1241607320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.info" returned: 0 in 0.863s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:17 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-bdb4b156-0d64-4a7a-8403-f120130db841 tempest-SnapshotDependencyTests-1241607320 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.info is being set with open permissions: ugo+rw Jul 07 17:44:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bdb4b156-0d64-4a7a-8403-f120130db841 tempest-SnapshotDependencyTests-1241607320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:17 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.info Jul 07 17:44:17 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:17 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-7f33ca55-a541-4e27-be34-359ad90a2f2d tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.853s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:17 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-7f33ca55-a541-4e27-be34-359ad90a2f2d tempest-ProjectMemberTests-1160045297 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:17 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-7f33ca55-a541-4e27-be34-359ad90a2f2d tempest-ProjectMemberTests-1160045297 None] Deleted volume successfully. Jul 07 17:44:17 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-7f33ca55-a541-4e27-be34-359ad90a2f2d tempest-ProjectMemberTests-1160045297 None] Lock "cinder-59018a04-6c34-477d-aa01-948c8bb32ca3-delete_volume" released by "delete_volume" :: held 2.720s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:17 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bdb4b156-0d64-4a7a-8403-f120130db841 tempest-SnapshotDependencyTests-1241607320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.info" returned: 0 in 0.839s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-bdb4b156-0d64-4a7a-8403-f120130db841 tempest-SnapshotDependencyTests-1241607320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.209s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:17 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:44:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Flow 'volume_create_manager' (b8bee22f-25b5-4cfb-b7af-bd9d2acca58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5accd3ef-e0ad-4d64-8918-3719489d61f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5accd3ef-e0ad-4d64-8918-3719489d61f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1347464737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00de67d-ddc4-4724-badd-6c1cd414ce5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0b58d71fa140d991a236c4f4eef6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:18Z,use_quota=True,user_id='11c2377e77ba472e95fe61cd6ab8ed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2a51c0-43fe-471a-9c89-31d0e5da1012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2a51c0-43fe-471a-9c89-31d0e5da1012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:17 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16041a9d-0db6-470f-9cd7-6f5e91fe1704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16041a9d-0db6-470f-9cd7-6f5e91fe1704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd00de67d-ddc4-4724-badd-6c1cd414ce5d', 'volume_name': 'volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57e6070-79cd-48d9-acce-e9c1aeb3a9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57e6070-79cd-48d9-acce-e9c1aeb3a9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:18 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb98efa3-9784-4463-8f6a-6f2a53b2990a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:18 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Volume d00de67d-ddc4-4724-badd-6c1cd414ce5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d', 'volume_size': 1} Jul 07 17:44:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:18 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1347464737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00de67d-ddc4-4724-badd-6c1cd414ce5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0b58d71fa140d991a236c4f4eef6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:18Z,use_quota=True,user_id='11c2377e77ba472e95fe61cd6ab8ed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:18 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Creating volume d00de67d-ddc4-4724-badd-6c1cd414ce5d {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:18 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:18 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:18 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:18 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:44:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:18 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-bdb4b156-0d64-4a7a-8403-f120130db841 tempest-SnapshotDependencyTests-1241607320 None] Create snapshot completed successfully Jul 07 17:44:18 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d 1073741824 Jul 07 17:44:18 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:19 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d 1073741824" returned: 0 in 0.990s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:19 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d Jul 07 17:44:19 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Flow 'volume_create_manager' (600cc9d1-ecb6-407e-9875-d0d576587f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9547777-6e57-4cb6-bff7-d7ebee7090d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9547777-6e57-4cb6-bff7-d7ebee7090d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77832a8b-5258-495d-a8dd-91a9ba3b5310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16993691a68645f4b022354484184208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c1a6b7cc-1e67-454a-bbda-09a5a69f089b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:20Z,use_quota=True,user_id='3159765875004cd896891e5126861851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cd1769-f51d-4db4-8cd9-e93e8f8f5023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cd1769-f51d-4db4-8cd9-e93e8f8f5023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7984d6f-0596-4ac3-ab2d-d4ff8f2281e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7984d6f-0596-4ac3-ab2d-d4ff8f2281e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '77832a8b-5258-495d-a8dd-91a9ba3b5310', 'volume_name': 'volume-77832a8b-5258-495d-a8dd-91a9ba3b5310', 'volume_size': 1, 'snapshot_id': 'c1a6b7cc-1e67-454a-bbda-09a5a69f089b'}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc2de47-15bb-4f03-8dec-7c370261105f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc2de47-15bb-4f03-8dec-7c370261105f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746a9558-74a8-4882-8e9c-993eece5fb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:19 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Volume 77832a8b-5258-495d-a8dd-91a9ba3b5310: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-77832a8b-5258-495d-a8dd-91a9ba3b5310', 'volume_size': 1, 'snapshot_id': 'c1a6b7cc-1e67-454a-bbda-09a5a69f089b'} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:19 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d" returned: 0 in 0.768s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.048s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Acquiring lock "cinder-quobyte-c1a6b7cc-1e67-454a-bbda-09a5a69f089b-77832a8b-5258-495d-a8dd-91a9ba3b5310" by "_create_volume_from_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb98efa3-9784-4463-8f6a-6f2a53b2990a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f79c54-49fc-4482-ac11-0ae878747097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Lock "cinder-quobyte-c1a6b7cc-1e67-454a-bbda-09a5a69f089b-77832a8b-5258-495d-a8dd-91a9ba3b5310" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Creating volume 77832a8b-5258-495d-a8dd-91a9ba3b5310 from snapshot c1a6b7cc-1e67-454a-bbda-09a5a69f089b {{(pid=87303) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Acquiring lock "cinder-quobyte-77832a8b-5258-495d-a8dd-91a9ba3b5310" by "_copy_volume_from_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:19 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Volume volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d (d00de67d-ddc4-4724-badd-6c1cd414ce5d): created successfully Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f79c54-49fc-4482-ac11-0ae878747097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Flow 'volume_create_manager' (b8bee22f-25b5-4cfb-b7af-bd9d2acca58f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Lock "cinder-quobyte-77832a8b-5258-495d-a8dd-91a9ba3b5310" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] snapshot: c1a6b7cc-1e67-454a-bbda-09a5a69f089b, volume: 77832a8b-5258-495d-a8dd-91a9ba3b5310, {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:44:19 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-96ae6160-e990-459e-8d95-50d6cc2c73f9 tempest-ProjectMemberTests-1160045297 None] Created volume successfully. Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[6676c8f3-aa99-4e11-b5d2-b280fb83af1b]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.c1a6b7cc-1e67-454a-bbda-09a5a69f089b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:20 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.c1a6b7cc-1e67-454a-bbda-09a5a69f089b Jul 07 17:44:20 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:20 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.c1a6b7cc-1e67-454a-bbda-09a5a69f089b" returned: 0 in 0.944s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-974633b3-a2c6-4d94-9813-68b434acc848(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:44:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848 {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:44:20 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Creating direct copy from snapshot {{(pid=87303) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:44:20 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[6483cf8c-e9ce-4f63-85e7-518d0a1510f8]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:21 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848 Jul 07 17:44:21 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6b18aafa-c2b7-43db-b269-92e185a3850d tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:21 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848" returned: 0 in 0.850s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:21 devstack cinder-volume[87303]: DEBUG cinder.utils [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Path /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-77832a8b-5258-495d-a8dd-91a9ba3b5310 not found in is_blk_device check {{(pid=87303) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:44:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-77832a8b-5258-495d-a8dd-91a9ba3b5310 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:21 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-77832a8b-5258-495d-a8dd-91a9ba3b5310 Jul 07 17:44:21 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:26 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-77832a8b-5258-495d-a8dd-91a9ba3b5310" returned: 0 in 4.977s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:26 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f5c8ad-c1de-49b1-92b8-85d606792f9a]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:26 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848 Jul 07 17:44:26 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:27 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848" returned: 0 in 1.002s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:27 devstack cinder-volume[87303]: DEBUG cinder.image.image_utils [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Image conversion details: src /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848, size 1024.00 MB, duration 4.98 sec, destination /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-77832a8b-5258-495d-a8dd-91a9ba3b5310 {{(pid=87303) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:44:27 devstack cinder-volume[87303]: INFO cinder.image.image_utils [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Converted 1024.00 MB image at 205.70 MB/s Jul 07 17:44:27 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-77832a8b-5258-495d-a8dd-91a9ba3b5310 is being set with open permissions: ugo+rw Jul 07 17:44:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-77832a8b-5258-495d-a8dd-91a9ba3b5310 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:27 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-77832a8b-5258-495d-a8dd-91a9ba3b5310 Jul 07 17:44:27 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:28 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-77832a8b-5258-495d-a8dd-91a9ba3b5310" returned: 0 in 0.721s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Lock "cinder-quobyte-77832a8b-5258-495d-a8dd-91a9ba3b5310" released by "_copy_volume_from_snapshot" :: held 8.599s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Lock "cinder-quobyte-c1a6b7cc-1e67-454a-bbda-09a5a69f089b-77832a8b-5258-495d-a8dd-91a9ba3b5310" released by "_create_volume_from_snapshot" :: held 8.658s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.695s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6b18aafa-c2b7-43db-b269-92e185a3850d tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.288s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:28 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-6b18aafa-c2b7-43db-b269-92e185a3850d tempest-ProjectMemberTests-1160045297 None] Creating offline snapshot 13a6d975-4fd2-4b2a-99a5-e917e84aaea4 of volume d00de67d-ddc4-4724-badd-6c1cd414ce5d {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:44:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746a9558-74a8-4882-8e9c-993eece5fb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77832a8b-5258-495d-a8dd-91a9ba3b5310', 'volume_size': 1, 'snapshot_id': 'c1a6b7cc-1e67-454a-bbda-09a5a69f089b'}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389cb71d-35b2-4944-aaad-8d4f3f95a3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:28 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08eef25-79ca-4743-8556-d0aee171189d]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6b18aafa-c2b7-43db-b269-92e185a3850d tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:28 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Volume volume-77832a8b-5258-495d-a8dd-91a9ba3b5310 (77832a8b-5258-495d-a8dd-91a9ba3b5310): created successfully Jul 07 17:44:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389cb71d-35b2-4944-aaad-8d4f3f95a3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:28 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Flow 'volume_create_manager' (600cc9d1-ecb6-407e-9875-d0d576587f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:28 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-05f0b553-1a6d-4923-86f0-b046968dce6b tempest-SnapshotDependencyTests-1241607320 None] Created volume successfully. Jul 07 17:44:28 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d Jul 07 17:44:28 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-41d89b7e-99d9-4984-a9ea-c68bf7b7756d tempest-SnapshotDependencyTests-1241607320 None] Acquiring lock "cinder-c1a6b7cc-1e67-454a-bbda-09a5a69f089b-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:29 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-41d89b7e-99d9-4984-a9ea-c68bf7b7756d tempest-SnapshotDependencyTests-1241607320 None] Lock "cinder-c1a6b7cc-1e67-454a-bbda-09a5a69f089b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-41d89b7e-99d9-4984-a9ea-c68bf7b7756d tempest-SnapshotDependencyTests-1241607320 None] Acquiring lock "cinder-quobyte-974633b3-a2c6-4d94-9813-68b434acc848" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6b18aafa-c2b7-43db-b269-92e185a3850d tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d" returned: 0 in 1.072s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6b18aafa-c2b7-43db-b269-92e185a3850d tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.13a6d975-4fd2-4b2a-99a5-e917e84aaea4 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-41d89b7e-99d9-4984-a9ea-c68bf7b7756d tempest-SnapshotDependencyTests-1241607320 None] Lock "cinder-quobyte-974633b3-a2c6-4d94-9813-68b434acc848" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-41d89b7e-99d9-4984-a9ea-c68bf7b7756d tempest-SnapshotDependencyTests-1241607320 None] Acquiring lock "cinder-quobyte-c1a6b7cc-1e67-454a-bbda-09a5a69f089b" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:29 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.13a6d975-4fd2-4b2a-99a5-e917e84aaea4 1G Jul 07 17:44:29 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:29 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-41d89b7e-99d9-4984-a9ea-c68bf7b7756d tempest-SnapshotDependencyTests-1241607320 None] Lock "cinder-quobyte-c1a6b7cc-1e67-454a-bbda-09a5a69f089b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-41d89b7e-99d9-4984-a9ea-c68bf7b7756d tempest-SnapshotDependencyTests-1241607320 None] Deleting offline snapshot c1a6b7cc-1e67-454a-bbda-09a5a69f089b of volume 974633b3-a2c6-4d94-9813-68b434acc848 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:44:29 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-41d89b7e-99d9-4984-a9ea-c68bf7b7756d tempest-SnapshotDependencyTests-1241607320 None] snapshot_file for this snap is: volume-974633b3-a2c6-4d94-9813-68b434acc848.c1a6b7cc-1e67-454a-bbda-09a5a69f089b {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:44:29 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a287a27-43ba-43fd-bc85-faa1120cee7a]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:29 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-41d89b7e-99d9-4984-a9ea-c68bf7b7756d tempest-SnapshotDependencyTests-1241607320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.c1a6b7cc-1e67-454a-bbda-09a5a69f089b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:29 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.c1a6b7cc-1e67-454a-bbda-09a5a69f089b Jul 07 17:44:29 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:30 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-41d89b7e-99d9-4984-a9ea-c68bf7b7756d tempest-SnapshotDependencyTests-1241607320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.c1a6b7cc-1e67-454a-bbda-09a5a69f089b" returned: 0 in 0.884s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:30 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-41d89b7e-99d9-4984-a9ea-c68bf7b7756d tempest-SnapshotDependencyTests-1241607320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-974633b3-a2c6-4d94-9813-68b434acc848(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:44:30 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8132cc9-f487-496e-bf94-77ed87ec233d]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-41d89b7e-99d9-4984-a9ea-c68bf7b7756d tempest-SnapshotDependencyTests-1241607320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:30 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6b18aafa-c2b7-43db-b269-92e185a3850d tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.13a6d975-4fd2-4b2a-99a5-e917e84aaea4 1G" returned: 0 in 1.018s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:30 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6b18aafa-c2b7-43db-b269-92e185a3850d tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.13a6d975-4fd2-4b2a-99a5-e917e84aaea4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:30 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.13a6d975-4fd2-4b2a-99a5-e917e84aaea4 Jul 07 17:44:30 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:30 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848 Jul 07 17:44:30 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:31 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6b18aafa-c2b7-43db-b269-92e185a3850d tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.13a6d975-4fd2-4b2a-99a5-e917e84aaea4" returned: 0 in 0.813s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:31 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-6b18aafa-c2b7-43db-b269-92e185a3850d tempest-ProjectMemberTests-1160045297 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.13a6d975-4fd2-4b2a-99a5-e917e84aaea4 is being set with open permissions: ugo+rw Jul 07 17:44:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6b18aafa-c2b7-43db-b269-92e185a3850d tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.13a6d975-4fd2-4b2a-99a5-e917e84aaea4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:31 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.13a6d975-4fd2-4b2a-99a5-e917e84aaea4 Jul 07 17:44:31 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:31 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-41d89b7e-99d9-4984-a9ea-c68bf7b7756d tempest-SnapshotDependencyTests-1241607320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848" returned: 0 in 0.939s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:31 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-41d89b7e-99d9-4984-a9ea-c68bf7b7756d tempest-SnapshotDependencyTests-1241607320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.c1a6b7cc-1e67-454a-bbda-09a5a69f089b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:31 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.c1a6b7cc-1e67-454a-bbda-09a5a69f089b Jul 07 17:44:31 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:32 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6b18aafa-c2b7-43db-b269-92e185a3850d tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.13a6d975-4fd2-4b2a-99a5-e917e84aaea4" returned: 0 in 0.852s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6b18aafa-c2b7-43db-b269-92e185a3850d tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:32 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.info Jul 07 17:44:32 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:32 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-41d89b7e-99d9-4984-a9ea-c68bf7b7756d tempest-SnapshotDependencyTests-1241607320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.c1a6b7cc-1e67-454a-bbda-09a5a69f089b" returned: 0 in 0.968s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:32 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-41d89b7e-99d9-4984-a9ea-c68bf7b7756d tempest-SnapshotDependencyTests-1241607320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.c1a6b7cc-1e67-454a-bbda-09a5a69f089b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:32 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.c1a6b7cc-1e67-454a-bbda-09a5a69f089b Jul 07 17:44:32 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:33 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6b18aafa-c2b7-43db-b269-92e185a3850d tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.info" returned: 0 in 0.783s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:33 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-6b18aafa-c2b7-43db-b269-92e185a3850d tempest-ProjectMemberTests-1160045297 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.info is being set with open permissions: ugo+rw Jul 07 17:44:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6b18aafa-c2b7-43db-b269-92e185a3850d tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:33 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.info Jul 07 17:44:33 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:33 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-41d89b7e-99d9-4984-a9ea-c68bf7b7756d tempest-SnapshotDependencyTests-1241607320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848.c1a6b7cc-1e67-454a-bbda-09a5a69f089b" returned: 0 in 0.810s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-41d89b7e-99d9-4984-a9ea-c68bf7b7756d tempest-SnapshotDependencyTests-1241607320 None] Lock "cinder-quobyte-c1a6b7cc-1e67-454a-bbda-09a5a69f089b" released by "_delete_snapshot" :: held 3.721s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-41d89b7e-99d9-4984-a9ea-c68bf7b7756d tempest-SnapshotDependencyTests-1241607320 None] Lock "cinder-quobyte-974633b3-a2c6-4d94-9813-68b434acc848" released by "delete_snapshot" :: held 3.760s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:33 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-41d89b7e-99d9-4984-a9ea-c68bf7b7756d tempest-SnapshotDependencyTests-1241607320 None] Created reservations ['5be326a3-537d-4547-b4d9-c578d73ea178', '4014596b-b57a-490e-a0e6-b8e5937a1940', 'f07c9763-3225-4276-a099-ef99c0e4f789', 'e3d98f96-1714-47fa-90c3-fa96760e552f'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:33 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-41d89b7e-99d9-4984-a9ea-c68bf7b7756d tempest-SnapshotDependencyTests-1241607320 None] Delete snapshot completed successfully. Jul 07 17:44:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-41d89b7e-99d9-4984-a9ea-c68bf7b7756d tempest-SnapshotDependencyTests-1241607320 None] Lock "cinder-c1a6b7cc-1e67-454a-bbda-09a5a69f089b-delete_snapshot" released by "delete_snapshot" :: held 3.961s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-99d13770-d570-4027-9d05-51fbd6c652a1 tempest-SnapshotDependencyTests-1241607320 None] Acquiring lock "cinder-974633b3-a2c6-4d94-9813-68b434acc848-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:33 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-99d13770-d570-4027-9d05-51fbd6c652a1 tempest-SnapshotDependencyTests-1241607320 None] Lock "cinder-974633b3-a2c6-4d94-9813-68b434acc848-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:33 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6b18aafa-c2b7-43db-b269-92e185a3850d tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.info" returned: 0 in 0.794s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:33 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6b18aafa-c2b7-43db-b269-92e185a3850d tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.465s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-99d13770-d570-4027-9d05-51fbd6c652a1 tempest-SnapshotDependencyTests-1241607320 None] Acquiring lock "cinder-quobyte-974633b3-a2c6-4d94-9813-68b434acc848" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:34 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-6b18aafa-c2b7-43db-b269-92e185a3850d tempest-ProjectMemberTests-1160045297 None] Create snapshot completed successfully Jul 07 17:44:34 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-99d13770-d570-4027-9d05-51fbd6c652a1 tempest-SnapshotDependencyTests-1241607320 None] Lock "cinder-quobyte-974633b3-a2c6-4d94-9813-68b434acc848" acquired by "delete_volume" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:34 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[5958d635-443a-4e89-9479-9819ee40d056]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:34 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-99d13770-d570-4027-9d05-51fbd6c652a1 tempest-SnapshotDependencyTests-1241607320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:34 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848 Jul 07 17:44:34 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:35 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c1da728a-05db-4c3a-b3fd-aaaacfc43d95 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-13a6d975-4fd2-4b2a-99a5-e917e84aaea4-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-99d13770-d570-4027-9d05-51fbd6c652a1 tempest-SnapshotDependencyTests-1241607320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848" returned: 0 in 0.933s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-99d13770-d570-4027-9d05-51fbd6c652a1 tempest-SnapshotDependencyTests-1241607320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c1da728a-05db-4c3a-b3fd-aaaacfc43d95 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-13a6d975-4fd2-4b2a-99a5-e917e84aaea4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c1da728a-05db-4c3a-b3fd-aaaacfc43d95 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-d00de67d-ddc4-4724-badd-6c1cd414ce5d" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:35 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848 Jul 07 17:44:35 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c1da728a-05db-4c3a-b3fd-aaaacfc43d95 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-d00de67d-ddc4-4724-badd-6c1cd414ce5d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c1da728a-05db-4c3a-b3fd-aaaacfc43d95 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-13a6d975-4fd2-4b2a-99a5-e917e84aaea4" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c1da728a-05db-4c3a-b3fd-aaaacfc43d95 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-13a6d975-4fd2-4b2a-99a5-e917e84aaea4" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:35 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-c1da728a-05db-4c3a-b3fd-aaaacfc43d95 tempest-ProjectMemberTests-1160045297 None] Deleting offline snapshot 13a6d975-4fd2-4b2a-99a5-e917e84aaea4 of volume d00de67d-ddc4-4724-badd-6c1cd414ce5d {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:44:35 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-c1da728a-05db-4c3a-b3fd-aaaacfc43d95 tempest-ProjectMemberTests-1160045297 None] snapshot_file for this snap is: volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.13a6d975-4fd2-4b2a-99a5-e917e84aaea4 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:44:35 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[818dde0e-40fc-4bf6-a2b6-7ec8ac662c1c]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c1da728a-05db-4c3a-b3fd-aaaacfc43d95 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.13a6d975-4fd2-4b2a-99a5-e917e84aaea4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:35 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.13a6d975-4fd2-4b2a-99a5-e917e84aaea4 Jul 07 17:44:35 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:35 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:35 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-99d13770-d570-4027-9d05-51fbd6c652a1 tempest-SnapshotDependencyTests-1241607320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-974633b3-a2c6-4d94-9813-68b434acc848" returned: 0 in 0.787s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:35 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-99d13770-d570-4027-9d05-51fbd6c652a1 tempest-SnapshotDependencyTests-1241607320 None] Lock "cinder-quobyte-974633b3-a2c6-4d94-9813-68b434acc848" released by "delete_volume" :: held 1.798s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:35 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-99d13770-d570-4027-9d05-51fbd6c652a1 tempest-SnapshotDependencyTests-1241607320 None] Created reservations ['91f3b906-03b5-4072-92f6-27610b791c15', '40f4286f-119c-42c5-8e69-dc5fdfb0e967', '6088d7f8-377d-44c0-bd92-989e355ebb5c', '795c9c09-1ece-448e-a73f-f35d6115cdc3'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-99d13770-d570-4027-9d05-51fbd6c652a1 tempest-SnapshotDependencyTests-1241607320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-99d13770-d570-4027-9d05-51fbd6c652a1 tempest-SnapshotDependencyTests-1241607320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-99d13770-d570-4027-9d05-51fbd6c652a1 tempest-SnapshotDependencyTests-1241607320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-99d13770-d570-4027-9d05-51fbd6c652a1 tempest-SnapshotDependencyTests-1241607320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-99d13770-d570-4027-9d05-51fbd6c652a1 tempest-SnapshotDependencyTests-1241607320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-99d13770-d570-4027-9d05-51fbd6c652a1 tempest-SnapshotDependencyTests-1241607320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:36 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:44:36 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:36 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c1da728a-05db-4c3a-b3fd-aaaacfc43d95 tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.13a6d975-4fd2-4b2a-99a5-e917e84aaea4" returned: 0 in 0.978s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:36 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-c1da728a-05db-4c3a-b3fd-aaaacfc43d95 tempest-ProjectMemberTests-1160045297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:44:36 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ad20e6-0535-4270-ba77-dbb921d0208a]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c1da728a-05db-4c3a-b3fd-aaaacfc43d95 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a932a5a2-4913-4b14-acee-4d6602b7e846 tempest-SnapshotDependencyTests-1241607320 None] Acquiring lock "cinder-77832a8b-5258-495d-a8dd-91a9ba3b5310-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a932a5a2-4913-4b14-acee-4d6602b7e846 tempest-SnapshotDependencyTests-1241607320 None] Lock "cinder-77832a8b-5258-495d-a8dd-91a9ba3b5310-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a932a5a2-4913-4b14-acee-4d6602b7e846 tempest-SnapshotDependencyTests-1241607320 None] Acquiring lock "cinder-quobyte-77832a8b-5258-495d-a8dd-91a9ba3b5310" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:36 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d Jul 07 17:44:36 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a932a5a2-4913-4b14-acee-4d6602b7e846 tempest-SnapshotDependencyTests-1241607320 None] Lock "cinder-quobyte-77832a8b-5258-495d-a8dd-91a9ba3b5310" acquired by "delete_volume" :: waited 0.028s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:36 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[8040ce7f-5980-4859-ac67-fc0654fe210e]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a932a5a2-4913-4b14-acee-4d6602b7e846 tempest-SnapshotDependencyTests-1241607320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-77832a8b-5258-495d-a8dd-91a9ba3b5310 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:36 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-77832a8b-5258-495d-a8dd-91a9ba3b5310 Jul 07 17:44:36 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:36 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:36 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-99d13770-d570-4027-9d05-51fbd6c652a1 tempest-SnapshotDependencyTests-1241607320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.840s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:36 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-99d13770-d570-4027-9d05-51fbd6c652a1 tempest-SnapshotDependencyTests-1241607320 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:36 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-99d13770-d570-4027-9d05-51fbd6c652a1 tempest-SnapshotDependencyTests-1241607320 None] Deleted volume successfully. Jul 07 17:44:36 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-99d13770-d570-4027-9d05-51fbd6c652a1 tempest-SnapshotDependencyTests-1241607320 None] Lock "cinder-974633b3-a2c6-4d94-9813-68b434acc848-delete_volume" released by "delete_volume" :: held 2.959s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:37 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c1da728a-05db-4c3a-b3fd-aaaacfc43d95 tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d" returned: 0 in 0.929s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c1da728a-05db-4c3a-b3fd-aaaacfc43d95 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.13a6d975-4fd2-4b2a-99a5-e917e84aaea4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:37 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.13a6d975-4fd2-4b2a-99a5-e917e84aaea4 Jul 07 17:44:37 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:37 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a932a5a2-4913-4b14-acee-4d6602b7e846 tempest-SnapshotDependencyTests-1241607320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-77832a8b-5258-495d-a8dd-91a9ba3b5310" returned: 0 in 0.936s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a932a5a2-4913-4b14-acee-4d6602b7e846 tempest-SnapshotDependencyTests-1241607320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-77832a8b-5258-495d-a8dd-91a9ba3b5310 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:37 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-77832a8b-5258-495d-a8dd-91a9ba3b5310 Jul 07 17:44:37 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:37 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c1da728a-05db-4c3a-b3fd-aaaacfc43d95 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.13a6d975-4fd2-4b2a-99a5-e917e84aaea4" returned: 0 in 0.800s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:37 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c1da728a-05db-4c3a-b3fd-aaaacfc43d95 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.13a6d975-4fd2-4b2a-99a5-e917e84aaea4 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:37 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.13a6d975-4fd2-4b2a-99a5-e917e84aaea4 Jul 07 17:44:37 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:38 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a932a5a2-4913-4b14-acee-4d6602b7e846 tempest-SnapshotDependencyTests-1241607320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-77832a8b-5258-495d-a8dd-91a9ba3b5310" returned: 0 in 0.765s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:38 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a932a5a2-4913-4b14-acee-4d6602b7e846 tempest-SnapshotDependencyTests-1241607320 None] Lock "cinder-quobyte-77832a8b-5258-495d-a8dd-91a9ba3b5310" released by "delete_volume" :: held 1.757s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:38 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-a932a5a2-4913-4b14-acee-4d6602b7e846 tempest-SnapshotDependencyTests-1241607320 None] Created reservations ['7beec5ec-2dc0-4532-9b26-644e288cb210', 'a925b803-c8d6-4ebd-99ce-da6199deffea', '305e2d67-52ca-4b24-8dab-3a98538911bf', '2b59b072-b294-45aa-b611-5290b5860faa'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a932a5a2-4913-4b14-acee-4d6602b7e846 tempest-SnapshotDependencyTests-1241607320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a932a5a2-4913-4b14-acee-4d6602b7e846 tempest-SnapshotDependencyTests-1241607320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a932a5a2-4913-4b14-acee-4d6602b7e846 tempest-SnapshotDependencyTests-1241607320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:38 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-a932a5a2-4913-4b14-acee-4d6602b7e846 tempest-SnapshotDependencyTests-1241607320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-a932a5a2-4913-4b14-acee-4d6602b7e846 tempest-SnapshotDependencyTests-1241607320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a932a5a2-4913-4b14-acee-4d6602b7e846 tempest-SnapshotDependencyTests-1241607320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:38 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:44:38 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:38 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:38 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c1da728a-05db-4c3a-b3fd-aaaacfc43d95 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d.13a6d975-4fd2-4b2a-99a5-e917e84aaea4" returned: 0 in 0.786s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:38 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c1da728a-05db-4c3a-b3fd-aaaacfc43d95 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-13a6d975-4fd2-4b2a-99a5-e917e84aaea4" released by "_delete_snapshot" :: held 3.650s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:38 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c1da728a-05db-4c3a-b3fd-aaaacfc43d95 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-d00de67d-ddc4-4724-badd-6c1cd414ce5d" released by "delete_snapshot" :: held 3.683s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:38 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-c1da728a-05db-4c3a-b3fd-aaaacfc43d95 tempest-ProjectMemberTests-1160045297 None] Created reservations ['17c796ef-d36a-4ccd-8e93-aaff11e71837', 'cca915af-0c54-47a4-afd3-09da8f561186', '2810996d-f7b5-4e06-a71b-d23f3e5c7d9c', '6b0102bc-a2ec-42ea-a4c8-cb25ab63270e'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:38 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-c1da728a-05db-4c3a-b3fd-aaaacfc43d95 tempest-ProjectMemberTests-1160045297 None] Delete snapshot completed successfully. Jul 07 17:44:38 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c1da728a-05db-4c3a-b3fd-aaaacfc43d95 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-13a6d975-4fd2-4b2a-99a5-e917e84aaea4-delete_snapshot" released by "delete_snapshot" :: held 3.882s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:39 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a932a5a2-4913-4b14-acee-4d6602b7e846 tempest-SnapshotDependencyTests-1241607320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.780s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:39 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-a932a5a2-4913-4b14-acee-4d6602b7e846 tempest-SnapshotDependencyTests-1241607320 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:39 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-a932a5a2-4913-4b14-acee-4d6602b7e846 tempest-SnapshotDependencyTests-1241607320 None] Deleted volume successfully. Jul 07 17:44:39 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a932a5a2-4913-4b14-acee-4d6602b7e846 tempest-SnapshotDependencyTests-1241607320 None] Lock "cinder-77832a8b-5258-495d-a8dd-91a9ba3b5310-delete_volume" released by "delete_volume" :: held 2.795s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:39 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1611d9c7-2207-48a9-af54-030f353fdd59 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-d00de67d-ddc4-4724-badd-6c1cd414ce5d-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:39 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1611d9c7-2207-48a9-af54-030f353fdd59 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-d00de67d-ddc4-4724-badd-6c1cd414ce5d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:39 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1611d9c7-2207-48a9-af54-030f353fdd59 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-d00de67d-ddc4-4724-badd-6c1cd414ce5d" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:39 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1611d9c7-2207-48a9-af54-030f353fdd59 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-d00de67d-ddc4-4724-badd-6c1cd414ce5d" acquired by "delete_volume" :: waited 0.024s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:39 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1098c89-53e1-4f5b-b9db-163221fdcfc5]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:39 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1611d9c7-2207-48a9-af54-030f353fdd59 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:39 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d Jul 07 17:44:39 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:40 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1611d9c7-2207-48a9-af54-030f353fdd59 tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d" returned: 0 in 0.964s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1611d9c7-2207-48a9-af54-030f353fdd59 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:40 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d Jul 07 17:44:40 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:41 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1611d9c7-2207-48a9-af54-030f353fdd59 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-d00de67d-ddc4-4724-badd-6c1cd414ce5d" returned: 0 in 0.742s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:41 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1611d9c7-2207-48a9-af54-030f353fdd59 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-d00de67d-ddc4-4724-badd-6c1cd414ce5d" released by "delete_volume" :: held 1.781s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:41 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-1611d9c7-2207-48a9-af54-030f353fdd59 tempest-ProjectMemberTests-1160045297 None] Created reservations ['654df655-f553-447f-94ae-f7e9c96da7bd', '0db7b612-ae94-43b0-a067-462a2cd830ab', '931038e5-07bb-4f20-8a0f-80f80241dbd4', 'a56e31f4-1ffc-466b-a4fc-0d840b6777a1'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1611d9c7-2207-48a9-af54-030f353fdd59 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1611d9c7-2207-48a9-af54-030f353fdd59 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:41 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1611d9c7-2207-48a9-af54-030f353fdd59 tempest-ProjectMemberTests-1160045297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:41 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-1611d9c7-2207-48a9-af54-030f353fdd59 tempest-ProjectMemberTests-1160045297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1611d9c7-2207-48a9-af54-030f353fdd59 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:41 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1611d9c7-2207-48a9-af54-030f353fdd59 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:41 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:44:41 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Flow 'volume_create_manager' (00f96654-a7a4-49eb-8b99-8a4140bd032b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:42 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f33640e-2ca3-48f7-be19-b8b1aeeccc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1611d9c7-2207-48a9-af54-030f353fdd59 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.848s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-1611d9c7-2207-48a9-af54-030f353fdd59 tempest-ProjectMemberTests-1160045297 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f33640e-2ca3-48f7-be19-b8b1aeeccc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1960288090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7254470b-653d-4df8-91e2-696b9e885ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0b58d71fa140d991a236c4f4eef6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:42Z,use_quota=True,user_id='11c2377e77ba472e95fe61cd6ab8ed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (133e5cdb-fc20-418c-9262-06544f28f718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (133e5cdb-fc20-418c-9262-06544f28f718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d5e420-6429-4973-af48-a3a10f990956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d5e420-6429-4973-af48-a3a10f990956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7254470b-653d-4df8-91e2-696b9e885ced', 'volume_name': 'volume-7254470b-653d-4df8-91e2-696b9e885ced', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07833d62-2230-411d-930c-c4ac6fe2a7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07833d62-2230-411d-930c-c4ac6fe2a7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55eafa71-a2a6-4746-8a54-b8d161be8f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:42 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Volume 7254470b-653d-4df8-91e2-696b9e885ced: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7254470b-653d-4df8-91e2-696b9e885ced', 'volume_size': 1} Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1960288090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7254470b-653d-4df8-91e2-696b9e885ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0b58d71fa140d991a236c4f4eef6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:42Z,use_quota=True,user_id='11c2377e77ba472e95fe61cd6ab8ed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Creating volume 7254470b-653d-4df8-91e2-696b9e885ced {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:42 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:42 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-1611d9c7-2207-48a9-af54-030f353fdd59 tempest-ProjectMemberTests-1160045297 None] Deleted volume successfully. Jul 07 17:44:42 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced 1073741824 Jul 07 17:44:42 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:42 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-1611d9c7-2207-48a9-af54-030f353fdd59 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-d00de67d-ddc4-4724-badd-6c1cd414ce5d-delete_volume" released by "delete_volume" :: held 3.100s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:43 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced 1073741824" returned: 0 in 1.042s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:43 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:43 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced Jul 07 17:44:43 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:44 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced" returned: 0 in 0.811s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:44 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:44:44 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55eafa71-a2a6-4746-8a54-b8d161be8f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7254470b-653d-4df8-91e2-696b9e885ced', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22bb7569-6884-4a46-8765-59dd8bebaaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:44 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Volume volume-7254470b-653d-4df8-91e2-696b9e885ced (7254470b-653d-4df8-91e2-696b9e885ced): created successfully Jul 07 17:44:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22bb7569-6884-4a46-8765-59dd8bebaaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:44 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Flow 'volume_create_manager' (00f96654-a7a4-49eb-8b99-8a4140bd032b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:44 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-5cb239d9-6748-493c-a600-a1454db8bae3 tempest-ProjectMemberTests-1160045297 None] Created volume successfully. Jul 07 17:44:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c837fba8-57ae-4643-a640-bbed91d65cb0 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c837fba8-57ae-4643-a640-bbed91d65cb0 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:45 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-c837fba8-57ae-4643-a640-bbed91d65cb0 tempest-ProjectMemberTests-1160045297 None] Creating offline snapshot 8e2c87b0-bb7c-42da-9a28-7dc719e5deec of volume 7254470b-653d-4df8-91e2-696b9e885ced {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:44:45 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9802fa-8928-4437-8f94-e1f0b70e39b2]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:45 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c837fba8-57ae-4643-a640-bbed91d65cb0 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:45 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced Jul 07 17:44:45 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:46 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c837fba8-57ae-4643-a640-bbed91d65cb0 tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced" returned: 0 in 0.952s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:46 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c837fba8-57ae-4643-a640-bbed91d65cb0 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.8e2c87b0-bb7c-42da-9a28-7dc719e5deec 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:46 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.8e2c87b0-bb7c-42da-9a28-7dc719e5deec 1G Jul 07 17:44:46 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:47 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c837fba8-57ae-4643-a640-bbed91d65cb0 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.8e2c87b0-bb7c-42da-9a28-7dc719e5deec 1G" returned: 0 in 1.087s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:47 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c837fba8-57ae-4643-a640-bbed91d65cb0 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7254470b-653d-4df8-91e2-696b9e885ced -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.8e2c87b0-bb7c-42da-9a28-7dc719e5deec {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:47 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7254470b-653d-4df8-91e2-696b9e885ced -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.8e2c87b0-bb7c-42da-9a28-7dc719e5deec Jul 07 17:44:47 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:48 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c837fba8-57ae-4643-a640-bbed91d65cb0 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7254470b-653d-4df8-91e2-696b9e885ced -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.8e2c87b0-bb7c-42da-9a28-7dc719e5deec" returned: 0 in 0.863s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:48 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-c837fba8-57ae-4643-a640-bbed91d65cb0 tempest-ProjectMemberTests-1160045297 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.8e2c87b0-bb7c-42da-9a28-7dc719e5deec is being set with open permissions: ugo+rw Jul 07 17:44:48 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c837fba8-57ae-4643-a640-bbed91d65cb0 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.8e2c87b0-bb7c-42da-9a28-7dc719e5deec {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:48 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.8e2c87b0-bb7c-42da-9a28-7dc719e5deec Jul 07 17:44:48 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:49 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c837fba8-57ae-4643-a640-bbed91d65cb0 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.8e2c87b0-bb7c-42da-9a28-7dc719e5deec" returned: 0 in 0.900s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c837fba8-57ae-4643-a640-bbed91d65cb0 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:49 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.info Jul 07 17:44:49 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:50 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c837fba8-57ae-4643-a640-bbed91d65cb0 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.info" returned: 0 in 0.753s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:50 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-c837fba8-57ae-4643-a640-bbed91d65cb0 tempest-ProjectMemberTests-1160045297 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.info is being set with open permissions: ugo+rw Jul 07 17:44:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c837fba8-57ae-4643-a640-bbed91d65cb0 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:50 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.info Jul 07 17:44:50 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:51 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c837fba8-57ae-4643-a640-bbed91d65cb0 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.info" returned: 0 in 0.760s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c837fba8-57ae-4643-a640-bbed91d65cb0 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.413s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:51 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-c837fba8-57ae-4643-a640-bbed91d65cb0 tempest-ProjectMemberTests-1160045297 None] Create snapshot completed successfully Jul 07 17:44:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a86b6542-7361-4ca9-b2a4-0644d4b12ce9 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-8e2c87b0-bb7c-42da-9a28-7dc719e5deec-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a86b6542-7361-4ca9-b2a4-0644d4b12ce9 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-8e2c87b0-bb7c-42da-9a28-7dc719e5deec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a86b6542-7361-4ca9-b2a4-0644d4b12ce9 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-7254470b-653d-4df8-91e2-696b9e885ced" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a86b6542-7361-4ca9-b2a4-0644d4b12ce9 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-7254470b-653d-4df8-91e2-696b9e885ced" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a86b6542-7361-4ca9-b2a4-0644d4b12ce9 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-8e2c87b0-bb7c-42da-9a28-7dc719e5deec" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:52 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a86b6542-7361-4ca9-b2a4-0644d4b12ce9 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-8e2c87b0-bb7c-42da-9a28-7dc719e5deec" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:52 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-a86b6542-7361-4ca9-b2a4-0644d4b12ce9 tempest-ProjectMemberTests-1160045297 None] Deleting offline snapshot 8e2c87b0-bb7c-42da-9a28-7dc719e5deec of volume 7254470b-653d-4df8-91e2-696b9e885ced {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:44:52 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-a86b6542-7361-4ca9-b2a4-0644d4b12ce9 tempest-ProjectMemberTests-1160045297 None] snapshot_file for this snap is: volume-7254470b-653d-4df8-91e2-696b9e885ced.8e2c87b0-bb7c-42da-9a28-7dc719e5deec {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:44:52 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f7f698-f806-4012-9bc8-17a41c3a507e]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a86b6542-7361-4ca9-b2a4-0644d4b12ce9 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.8e2c87b0-bb7c-42da-9a28-7dc719e5deec {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:52 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.8e2c87b0-bb7c-42da-9a28-7dc719e5deec Jul 07 17:44:52 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:53 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a86b6542-7361-4ca9-b2a4-0644d4b12ce9 tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.8e2c87b0-bb7c-42da-9a28-7dc719e5deec" returned: 0 in 1.004s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:53 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-a86b6542-7361-4ca9-b2a4-0644d4b12ce9 tempest-ProjectMemberTests-1160045297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7254470b-653d-4df8-91e2-696b9e885ced(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:44:53 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[9999555f-64df-42bd-8929-385ddbad7d0f]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a86b6542-7361-4ca9-b2a4-0644d4b12ce9 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:53 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced Jul 07 17:44:53 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:53 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a86b6542-7361-4ca9-b2a4-0644d4b12ce9 tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced" returned: 0 in 0.847s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a86b6542-7361-4ca9-b2a4-0644d4b12ce9 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.8e2c87b0-bb7c-42da-9a28-7dc719e5deec {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:53 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.8e2c87b0-bb7c-42da-9a28-7dc719e5deec Jul 07 17:44:53 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:54 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a86b6542-7361-4ca9-b2a4-0644d4b12ce9 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.8e2c87b0-bb7c-42da-9a28-7dc719e5deec" returned: 0 in 0.836s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a86b6542-7361-4ca9-b2a4-0644d4b12ce9 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.8e2c87b0-bb7c-42da-9a28-7dc719e5deec {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:54 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.8e2c87b0-bb7c-42da-9a28-7dc719e5deec Jul 07 17:44:54 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:55 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-a86b6542-7361-4ca9-b2a4-0644d4b12ce9 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced.8e2c87b0-bb7c-42da-9a28-7dc719e5deec" returned: 0 in 0.662s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:55 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a86b6542-7361-4ca9-b2a4-0644d4b12ce9 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-8e2c87b0-bb7c-42da-9a28-7dc719e5deec" released by "_delete_snapshot" :: held 3.452s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:55 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a86b6542-7361-4ca9-b2a4-0644d4b12ce9 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-7254470b-653d-4df8-91e2-696b9e885ced" released by "delete_snapshot" :: held 3.477s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:55 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-a86b6542-7361-4ca9-b2a4-0644d4b12ce9 tempest-ProjectMemberTests-1160045297 None] Created reservations ['00933ea0-c8c9-45e7-86f9-ec8546eabb1c', '79054acc-652a-4b3c-9405-3e092b62eaa4', '2e76adaa-ec18-442f-afc3-63e66a271947', '93fb6adf-59ed-4275-a10b-429845ac5634'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:55 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-a86b6542-7361-4ca9-b2a4-0644d4b12ce9 tempest-ProjectMemberTests-1160045297 None] Delete snapshot completed successfully. Jul 07 17:44:55 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-a86b6542-7361-4ca9-b2a4-0644d4b12ce9 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-8e2c87b0-bb7c-42da-9a28-7dc719e5deec-delete_snapshot" released by "delete_snapshot" :: held 3.643s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-668dee98-ed76-4eb3-b670-9e17c611e4f3 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-7254470b-653d-4df8-91e2-696b9e885ced-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-668dee98-ed76-4eb3-b670-9e17c611e4f3 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-7254470b-653d-4df8-91e2-696b9e885ced-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-668dee98-ed76-4eb3-b670-9e17c611e4f3 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-7254470b-653d-4df8-91e2-696b9e885ced" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:44:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-668dee98-ed76-4eb3-b670-9e17c611e4f3 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-7254470b-653d-4df8-91e2-696b9e885ced" acquired by "delete_volume" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:44:56 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[607013ad-110c-4392-b400-f5ba195c773c]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:44:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-668dee98-ed76-4eb3-b670-9e17c611e4f3 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:56 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced Jul 07 17:44:56 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:44:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:56 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:44:56 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:57 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-668dee98-ed76-4eb3-b670-9e17c611e4f3 tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced" returned: 0 in 0.874s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-668dee98-ed76-4eb3-b670-9e17c611e4f3 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:57 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced Jul 07 17:44:57 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:57 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.695s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:57 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:44:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:44:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:44:57 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-668dee98-ed76-4eb3-b670-9e17c611e4f3 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7254470b-653d-4df8-91e2-696b9e885ced" returned: 0 in 0.767s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:58 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-668dee98-ed76-4eb3-b670-9e17c611e4f3 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-7254470b-653d-4df8-91e2-696b9e885ced" released by "delete_volume" :: held 1.731s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:58 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-668dee98-ed76-4eb3-b670-9e17c611e4f3 tempest-ProjectMemberTests-1160045297 None] Created reservations ['c34b014c-71e3-4f01-ab2d-0a8bed8a33ac', '374a0a4f-e09d-409b-b60d-b9a41c5db08c', '60c3aac3-d49f-487f-9b9f-378abd23e742', '32826cb8-3327-4571-8056-c34e0001fd96'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:44:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-668dee98-ed76-4eb3-b670-9e17c611e4f3 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-668dee98-ed76-4eb3-b670-9e17c611e4f3 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:58 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-668dee98-ed76-4eb3-b670-9e17c611e4f3 tempest-ProjectMemberTests-1160045297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:58 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-668dee98-ed76-4eb3-b670-9e17c611e4f3 tempest-ProjectMemberTests-1160045297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-668dee98-ed76-4eb3-b670-9e17c611e4f3 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-668dee98-ed76-4eb3-b670-9e17c611e4f3 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:58 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:44:58 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:58 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-668dee98-ed76-4eb3-b670-9e17c611e4f3 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.733s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:58 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-668dee98-ed76-4eb3-b670-9e17c611e4f3 tempest-ProjectMemberTests-1160045297 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:58 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-668dee98-ed76-4eb3-b670-9e17c611e4f3 tempest-ProjectMemberTests-1160045297 None] Deleted volume successfully. Jul 07 17:44:58 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-668dee98-ed76-4eb3-b670-9e17c611e4f3 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-7254470b-653d-4df8-91e2-696b9e885ced-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:44:58 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:44:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Flow 'volume_create_manager' (c690bd70-654b-4129-b09a-07ef59e7d9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:44:58 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd09bdf-d56d-4fb9-b0d3-8047687ef1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd09bdf-d56d-4fb9-b0d3-8047687ef1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-552944566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba3bf1e-707e-4b17-8e1a-6febe4079890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0b58d71fa140d991a236c4f4eef6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:59Z,use_quota=True,user_id='11c2377e77ba472e95fe61cd6ab8ed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e9611a-9636-4cc6-9915-8bdd8a9d3425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e9611a-9636-4cc6-9915-8bdd8a9d3425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b77232f-c96b-49e4-9bd6-3a5293dd39a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b77232f-c96b-49e4-9bd6-3a5293dd39a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fba3bf1e-707e-4b17-8e1a-6febe4079890', 'volume_name': 'volume-fba3bf1e-707e-4b17-8e1a-6febe4079890', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd29103-c672-4ec2-91f2-b585209c2662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd29103-c672-4ec2-91f2-b585209c2662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:44:59 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfe418e-4aa5-4aee-ac86-f3642d22565a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:44:59 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Volume fba3bf1e-707e-4b17-8e1a-6febe4079890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fba3bf1e-707e-4b17-8e1a-6febe4079890', 'volume_size': 1} Jul 07 17:44:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-552944566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba3bf1e-707e-4b17-8e1a-6febe4079890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0b58d71fa140d991a236c4f4eef6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:44:59Z,use_quota=True,user_id='11c2377e77ba472e95fe61cd6ab8ed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:44:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Creating volume fba3bf1e-707e-4b17-8e1a-6febe4079890 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:44:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:44:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:44:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:44:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:44:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:44:59 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:44:59 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:44:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:59 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890 1073741824 Jul 07 17:44:59 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:59 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:59 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890 1073741824" returned: 0 in 0.925s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:00 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890 Jul 07 17:45:00 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:00 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890" returned: 0 in 0.748s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:00 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:45:00 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:00 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfe418e-4aa5-4aee-ac86-f3642d22565a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fba3bf1e-707e-4b17-8e1a-6febe4079890', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:00 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990042aa-1af6-4d37-9f61-720ba8168648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:00 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Volume volume-fba3bf1e-707e-4b17-8e1a-6febe4079890 (fba3bf1e-707e-4b17-8e1a-6febe4079890): created successfully Jul 07 17:45:00 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990042aa-1af6-4d37-9f61-720ba8168648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:00 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Flow 'volume_create_manager' (c690bd70-654b-4129-b09a-07ef59e7d9b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:00 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-b9e4bbbb-ce85-4ec0-8f51-e52670868493 tempest-ProjectMemberTests-1160045297 None] Created volume successfully. Jul 07 17:45:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-eb21d755-5ffb-4e4d-8d17-cae56402663e tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-eb21d755-5ffb-4e4d-8d17-cae56402663e tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:01 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-eb21d755-5ffb-4e4d-8d17-cae56402663e tempest-ProjectMemberTests-1160045297 None] Creating offline snapshot 7b68a6e6-f488-4aa6-b182-580a282a472e of volume fba3bf1e-707e-4b17-8e1a-6febe4079890 {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:45:01 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac099e2-bfce-417c-a366-5608ff098eac]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:01 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-eb21d755-5ffb-4e4d-8d17-cae56402663e tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:01 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890 Jul 07 17:45:01 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:02 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-eb21d755-5ffb-4e4d-8d17-cae56402663e tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890" returned: 0 in 0.796s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-eb21d755-5ffb-4e4d-8d17-cae56402663e tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.7b68a6e6-f488-4aa6-b182-580a282a472e 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:02 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.7b68a6e6-f488-4aa6-b182-580a282a472e 1G Jul 07 17:45:02 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:02 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-eb21d755-5ffb-4e4d-8d17-cae56402663e tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.7b68a6e6-f488-4aa6-b182-580a282a472e 1G" returned: 0 in 0.868s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:02 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-eb21d755-5ffb-4e4d-8d17-cae56402663e tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fba3bf1e-707e-4b17-8e1a-6febe4079890 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.7b68a6e6-f488-4aa6-b182-580a282a472e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:02 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fba3bf1e-707e-4b17-8e1a-6febe4079890 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.7b68a6e6-f488-4aa6-b182-580a282a472e Jul 07 17:45:02 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:03 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-eb21d755-5ffb-4e4d-8d17-cae56402663e tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fba3bf1e-707e-4b17-8e1a-6febe4079890 -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.7b68a6e6-f488-4aa6-b182-580a282a472e" returned: 0 in 0.709s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:03 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-eb21d755-5ffb-4e4d-8d17-cae56402663e tempest-ProjectMemberTests-1160045297 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.7b68a6e6-f488-4aa6-b182-580a282a472e is being set with open permissions: ugo+rw Jul 07 17:45:03 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-eb21d755-5ffb-4e4d-8d17-cae56402663e tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.7b68a6e6-f488-4aa6-b182-580a282a472e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:03 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.7b68a6e6-f488-4aa6-b182-580a282a472e Jul 07 17:45:03 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:04 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-eb21d755-5ffb-4e4d-8d17-cae56402663e tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.7b68a6e6-f488-4aa6-b182-580a282a472e" returned: 0 in 0.655s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:04 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:UPDATE=88,cinder:SELECT=72,cinder:INSERT=20,cinder:DELETE=8 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:45:04 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:UPDATE=84,cinder:INSERT=25,cinder:DELETE=7,cinder:SELECT=65 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:45:04 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-eb21d755-5ffb-4e4d-8d17-cae56402663e tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:04 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.info Jul 07 17:45:04 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:05 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-eb21d755-5ffb-4e4d-8d17-cae56402663e tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.info" returned: 0 in 0.639s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:05 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-eb21d755-5ffb-4e4d-8d17-cae56402663e tempest-ProjectMemberTests-1160045297 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.info is being set with open permissions: ugo+rw Jul 07 17:45:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-eb21d755-5ffb-4e4d-8d17-cae56402663e tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:05 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.info Jul 07 17:45:05 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:05 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-eb21d755-5ffb-4e4d-8d17-cae56402663e tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.info" returned: 0 in 0.665s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:05 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-eb21d755-5ffb-4e4d-8d17-cae56402663e tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.425s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:05 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-eb21d755-5ffb-4e4d-8d17-cae56402663e tempest-ProjectMemberTests-1160045297 None] Create snapshot completed successfully Jul 07 17:45:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bcbafafb-7fd9-4c66-b142-87812caaf589 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-7b68a6e6-f488-4aa6-b182-580a282a472e-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bcbafafb-7fd9-4c66-b142-87812caaf589 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-7b68a6e6-f488-4aa6-b182-580a282a472e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bcbafafb-7fd9-4c66-b142-87812caaf589 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-fba3bf1e-707e-4b17-8e1a-6febe4079890" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bcbafafb-7fd9-4c66-b142-87812caaf589 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-fba3bf1e-707e-4b17-8e1a-6febe4079890" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bcbafafb-7fd9-4c66-b142-87812caaf589 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-7b68a6e6-f488-4aa6-b182-580a282a472e" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:06 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bcbafafb-7fd9-4c66-b142-87812caaf589 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-7b68a6e6-f488-4aa6-b182-580a282a472e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-bcbafafb-7fd9-4c66-b142-87812caaf589 tempest-ProjectMemberTests-1160045297 None] Deleting offline snapshot 7b68a6e6-f488-4aa6-b182-580a282a472e of volume fba3bf1e-707e-4b17-8e1a-6febe4079890 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:45:06 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-bcbafafb-7fd9-4c66-b142-87812caaf589 tempest-ProjectMemberTests-1160045297 None] snapshot_file for this snap is: volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.7b68a6e6-f488-4aa6-b182-580a282a472e {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:45:06 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[72db03b9-dc45-4f83-b2d4-6f6d73c7cec7]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:06 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bcbafafb-7fd9-4c66-b142-87812caaf589 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.7b68a6e6-f488-4aa6-b182-580a282a472e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:06 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.7b68a6e6-f488-4aa6-b182-580a282a472e Jul 07 17:45:06 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:07 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bcbafafb-7fd9-4c66-b142-87812caaf589 tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.7b68a6e6-f488-4aa6-b182-580a282a472e" returned: 0 in 0.831s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:07 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-bcbafafb-7fd9-4c66-b142-87812caaf589 tempest-ProjectMemberTests-1160045297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fba3bf1e-707e-4b17-8e1a-6febe4079890(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:45:07 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[3221233e-8a72-4ef3-907c-bf1206c53910]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:07 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bcbafafb-7fd9-4c66-b142-87812caaf589 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:07 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890 Jul 07 17:45:07 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:08 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bcbafafb-7fd9-4c66-b142-87812caaf589 tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890" returned: 0 in 0.806s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:08 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bcbafafb-7fd9-4c66-b142-87812caaf589 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.7b68a6e6-f488-4aa6-b182-580a282a472e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:08 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.7b68a6e6-f488-4aa6-b182-580a282a472e Jul 07 17:45:08 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:09 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bcbafafb-7fd9-4c66-b142-87812caaf589 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.7b68a6e6-f488-4aa6-b182-580a282a472e" returned: 0 in 0.760s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bcbafafb-7fd9-4c66-b142-87812caaf589 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.7b68a6e6-f488-4aa6-b182-580a282a472e {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:09 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.7b68a6e6-f488-4aa6-b182-580a282a472e Jul 07 17:45:09 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:09 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:09 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-bcbafafb-7fd9-4c66-b142-87812caaf589 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890.7b68a6e6-f488-4aa6-b182-580a282a472e" returned: 0 in 0.735s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:09 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bcbafafb-7fd9-4c66-b142-87812caaf589 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-7b68a6e6-f488-4aa6-b182-580a282a472e" released by "_delete_snapshot" :: held 3.234s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:09 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bcbafafb-7fd9-4c66-b142-87812caaf589 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-fba3bf1e-707e-4b17-8e1a-6febe4079890" released by "delete_snapshot" :: held 3.256s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:09 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-bcbafafb-7fd9-4c66-b142-87812caaf589 tempest-ProjectMemberTests-1160045297 None] Created reservations ['139a2215-b791-47c8-ae62-87e57e8f69ba', 'da6fc6ad-d65c-4a29-aab4-07090fb44f06', '46fbecc1-547e-4df3-9cd8-7c26aa438e58', '3ddeb675-322d-4fbd-b490-77c215e00ccd'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:09 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-bcbafafb-7fd9-4c66-b142-87812caaf589 tempest-ProjectMemberTests-1160045297 None] Delete snapshot completed successfully. Jul 07 17:45:09 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-bcbafafb-7fd9-4c66-b142-87812caaf589 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-7b68a6e6-f488-4aa6-b182-580a282a472e-delete_snapshot" released by "delete_snapshot" :: held 3.399s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c2c70014-0342-489a-8832-473c37336578 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-fba3bf1e-707e-4b17-8e1a-6febe4079890-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c2c70014-0342-489a-8832-473c37336578 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-fba3bf1e-707e-4b17-8e1a-6febe4079890-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c2c70014-0342-489a-8832-473c37336578 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-fba3bf1e-707e-4b17-8e1a-6febe4079890" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:10 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c2c70014-0342-489a-8832-473c37336578 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-fba3bf1e-707e-4b17-8e1a-6febe4079890" acquired by "delete_volume" :: waited 0.016s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:10 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[145a1ef4-ed3d-45cc-a110-dcebf987976f]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:10 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c2c70014-0342-489a-8832-473c37336578 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:11 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890 Jul 07 17:45:11 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:11 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c2c70014-0342-489a-8832-473c37336578 tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890" returned: 0 in 0.775s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:11 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c2c70014-0342-489a-8832-473c37336578 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:11 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890 Jul 07 17:45:11 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:12 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c2c70014-0342-489a-8832-473c37336578 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-fba3bf1e-707e-4b17-8e1a-6febe4079890" returned: 0 in 0.644s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:12 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c2c70014-0342-489a-8832-473c37336578 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-fba3bf1e-707e-4b17-8e1a-6febe4079890" released by "delete_volume" :: held 1.507s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:12 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-c2c70014-0342-489a-8832-473c37336578 tempest-ProjectMemberTests-1160045297 None] Created reservations ['925c25d3-bc5c-46d7-b1e8-af39676e476d', 'c7085196-a238-4338-b1d2-c4c3329014eb', '82758ffa-5f6e-4e06-9f89-4fc24fe2d0b4', 'be5a4eb8-e239-43a4-8af3-51b764897214'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c2c70014-0342-489a-8832-473c37336578 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c2c70014-0342-489a-8832-473c37336578 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c2c70014-0342-489a-8832-473c37336578 tempest-ProjectMemberTests-1160045297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:12 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-c2c70014-0342-489a-8832-473c37336578 tempest-ProjectMemberTests-1160045297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c2c70014-0342-489a-8832-473c37336578 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:12 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c2c70014-0342-489a-8832-473c37336578 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:12 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:45:12 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:13 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-c2c70014-0342-489a-8832-473c37336578 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.661s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-c2c70014-0342-489a-8832-473c37336578 tempest-ProjectMemberTests-1160045297 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:45:13 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-c2c70014-0342-489a-8832-473c37336578 tempest-ProjectMemberTests-1160045297 None] Deleted volume successfully. Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-c2c70014-0342-489a-8832-473c37336578 tempest-ProjectMemberTests-1160045297 None] Lock "cinder-fba3bf1e-707e-4b17-8e1a-6febe4079890-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Flow 'volume_create_manager' (69f87874-6055-4de3-bbb8-936d9577e3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bafa929-9e0a-406f-947b-ffc78816bfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bafa929-9e0a-406f-947b-ffc78816bfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-136671721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebde6d16-59d5-4828-80b6-d6f9209c266b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0b58d71fa140d991a236c4f4eef6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:13Z,use_quota=True,user_id='11c2377e77ba472e95fe61cd6ab8ed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2c7163-f416-49e2-90af-80005bdfcfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2c7163-f416-49e2-90af-80005bdfcfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c97d0f0-848e-4a6c-ae7f-efae41fae5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c97d0f0-848e-4a6c-ae7f-efae41fae5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebde6d16-59d5-4828-80b6-d6f9209c266b', 'volume_name': 'volume-ebde6d16-59d5-4828-80b6-d6f9209c266b', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9863a207-4415-45ad-8312-dddb211cc9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9863a207-4415-45ad-8312-dddb211cc9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b60844-91cc-4755-9851-686b26f1c506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:13 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Volume ebde6d16-59d5-4828-80b6-d6f9209c266b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebde6d16-59d5-4828-80b6-d6f9209c266b', 'volume_size': 1} Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-136671721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebde6d16-59d5-4828-80b6-d6f9209c266b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0b58d71fa140d991a236c4f4eef6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:13Z,use_quota=True,user_id='11c2377e77ba472e95fe61cd6ab8ed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Creating volume ebde6d16-59d5-4828-80b6-d6f9209c266b {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:45:13 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:45:13 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:13 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b 1073741824 Jul 07 17:45:13 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:14 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b 1073741824" returned: 0 in 0.930s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:14 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:14 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b Jul 07 17:45:14 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:15 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b" returned: 0 in 0.684s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:45:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b60844-91cc-4755-9851-686b26f1c506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebde6d16-59d5-4828-80b6-d6f9209c266b', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6606cb19-3750-4d50-959c-455bf5cf8a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:15 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Volume volume-ebde6d16-59d5-4828-80b6-d6f9209c266b (ebde6d16-59d5-4828-80b6-d6f9209c266b): created successfully Jul 07 17:45:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6606cb19-3750-4d50-959c-455bf5cf8a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:15 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Flow 'volume_create_manager' (69f87874-6055-4de3-bbb8-936d9577e3ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:15 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-9b829020-5b1b-413d-9495-315a0ca228a9 tempest-ProjectMemberTests-1160045297 None] Created volume successfully. Jul 07 17:45:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1b9b0389-3859-4ece-935d-77587479f2ee tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1b9b0389-3859-4ece-935d-77587479f2ee tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:15 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-1b9b0389-3859-4ece-935d-77587479f2ee tempest-ProjectMemberTests-1160045297 None] Creating offline snapshot 8e6b1e76-f4c3-48f1-976c-b65fb4ddc450 of volume ebde6d16-59d5-4828-80b6-d6f9209c266b {{(pid=87303) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:45:15 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[3695639a-fb92-4de1-acf4-969d97ef8595]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:15 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1b9b0389-3859-4ece-935d-77587479f2ee tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:15 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b Jul 07 17:45:15 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:16 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1b9b0389-3859-4ece-935d-77587479f2ee tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b" returned: 0 in 0.797s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:16 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1b9b0389-3859-4ece-935d-77587479f2ee tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.8e6b1e76-f4c3-48f1-976c-b65fb4ddc450 1G {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:16 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.8e6b1e76-f4c3-48f1-976c-b65fb4ddc450 1G Jul 07 17:45:16 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:17 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1b9b0389-3859-4ece-935d-77587479f2ee tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.8e6b1e76-f4c3-48f1-976c-b65fb4ddc450 1G" returned: 0 in 0.807s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:17 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1b9b0389-3859-4ece-935d-77587479f2ee tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebde6d16-59d5-4828-80b6-d6f9209c266b -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.8e6b1e76-f4c3-48f1-976c-b65fb4ddc450 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:17 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebde6d16-59d5-4828-80b6-d6f9209c266b -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.8e6b1e76-f4c3-48f1-976c-b65fb4ddc450 Jul 07 17:45:17 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:18 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1b9b0389-3859-4ece-935d-77587479f2ee tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebde6d16-59d5-4828-80b6-d6f9209c266b -F qcow2 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.8e6b1e76-f4c3-48f1-976c-b65fb4ddc450" returned: 0 in 0.716s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:18 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-1b9b0389-3859-4ece-935d-77587479f2ee tempest-ProjectMemberTests-1160045297 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.8e6b1e76-f4c3-48f1-976c-b65fb4ddc450 is being set with open permissions: ugo+rw Jul 07 17:45:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1b9b0389-3859-4ece-935d-77587479f2ee tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.8e6b1e76-f4c3-48f1-976c-b65fb4ddc450 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:18 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.8e6b1e76-f4c3-48f1-976c-b65fb4ddc450 Jul 07 17:45:18 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:18 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1b9b0389-3859-4ece-935d-77587479f2ee tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.8e6b1e76-f4c3-48f1-976c-b65fb4ddc450" returned: 0 in 0.760s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:18 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1b9b0389-3859-4ece-935d-77587479f2ee tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:18 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.info Jul 07 17:45:18 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:19 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1b9b0389-3859-4ece-935d-77587479f2ee tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.info" returned: 0 in 0.671s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:19 devstack cinder-volume[87303]: WARNING cinder.volume.drivers.remotefs [None req-1b9b0389-3859-4ece-935d-77587479f2ee tempest-ProjectMemberTests-1160045297 None] /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.info is being set with open permissions: ugo+rw Jul 07 17:45:19 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1b9b0389-3859-4ece-935d-77587479f2ee tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.info {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:19 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.info Jul 07 17:45:19 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:20 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-1b9b0389-3859-4ece-935d-77587479f2ee tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.info" returned: 0 in 0.685s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:20 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-1b9b0389-3859-4ece-935d-77587479f2ee tempest-ProjectMemberTests-1160045297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.523s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:20 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-1b9b0389-3859-4ece-935d-77587479f2ee tempest-ProjectMemberTests-1160045297 None] Create snapshot completed successfully Jul 07 17:45:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-125e3759-b03f-4a74-ba1a-52aa92bb4abc tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-8e6b1e76-f4c3-48f1-976c-b65fb4ddc450-delete_snapshot" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-125e3759-b03f-4a74-ba1a-52aa92bb4abc tempest-ProjectMemberTests-1160045297 None] Lock "cinder-8e6b1e76-f4c3-48f1-976c-b65fb4ddc450-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-125e3759-b03f-4a74-ba1a-52aa92bb4abc tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-ebde6d16-59d5-4828-80b6-d6f9209c266b" by "delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-125e3759-b03f-4a74-ba1a-52aa92bb4abc tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-ebde6d16-59d5-4828-80b6-d6f9209c266b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-125e3759-b03f-4a74-ba1a-52aa92bb4abc tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-8e6b1e76-f4c3-48f1-976c-b65fb4ddc450" by "_delete_snapshot" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:21 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-125e3759-b03f-4a74-ba1a-52aa92bb4abc tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-8e6b1e76-f4c3-48f1-976c-b65fb4ddc450" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-125e3759-b03f-4a74-ba1a-52aa92bb4abc tempest-ProjectMemberTests-1160045297 None] Deleting offline snapshot 8e6b1e76-f4c3-48f1-976c-b65fb4ddc450 of volume ebde6d16-59d5-4828-80b6-d6f9209c266b {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:45:21 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-125e3759-b03f-4a74-ba1a-52aa92bb4abc tempest-ProjectMemberTests-1160045297 None] snapshot_file for this snap is: volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.8e6b1e76-f4c3-48f1-976c-b65fb4ddc450 {{(pid=87303) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:45:21 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e16673-cc31-4673-9b15-3213022cbbd2]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:21 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-125e3759-b03f-4a74-ba1a-52aa92bb4abc tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.8e6b1e76-f4c3-48f1-976c-b65fb4ddc450 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:21 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.8e6b1e76-f4c3-48f1-976c-b65fb4ddc450 Jul 07 17:45:21 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:22 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-125e3759-b03f-4a74-ba1a-52aa92bb4abc tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.8e6b1e76-f4c3-48f1-976c-b65fb4ddc450" returned: 0 in 0.834s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:22 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-125e3759-b03f-4a74-ba1a-52aa92bb4abc tempest-ProjectMemberTests-1160045297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebde6d16-59d5-4828-80b6-d6f9209c266b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87303) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:45:22 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6320a62-cfb5-4020-9791-ab3da54594b3]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-125e3759-b03f-4a74-ba1a-52aa92bb4abc tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:22 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b Jul 07 17:45:22 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:22 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-125e3759-b03f-4a74-ba1a-52aa92bb4abc tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b" returned: 0 in 0.840s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:22 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-125e3759-b03f-4a74-ba1a-52aa92bb4abc tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.8e6b1e76-f4c3-48f1-976c-b65fb4ddc450 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:22 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.8e6b1e76-f4c3-48f1-976c-b65fb4ddc450 Jul 07 17:45:22 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:23 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-125e3759-b03f-4a74-ba1a-52aa92bb4abc tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.8e6b1e76-f4c3-48f1-976c-b65fb4ddc450" returned: 0 in 0.828s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:23 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-125e3759-b03f-4a74-ba1a-52aa92bb4abc tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.8e6b1e76-f4c3-48f1-976c-b65fb4ddc450 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:23 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.8e6b1e76-f4c3-48f1-976c-b65fb4ddc450 Jul 07 17:45:23 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:24 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:24 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-125e3759-b03f-4a74-ba1a-52aa92bb4abc tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b.8e6b1e76-f4c3-48f1-976c-b65fb4ddc450" returned: 0 in 0.704s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-125e3759-b03f-4a74-ba1a-52aa92bb4abc tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-8e6b1e76-f4c3-48f1-976c-b65fb4ddc450" released by "_delete_snapshot" :: held 3.320s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-125e3759-b03f-4a74-ba1a-52aa92bb4abc tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-ebde6d16-59d5-4828-80b6-d6f9209c266b" released by "delete_snapshot" :: held 3.345s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:24 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-125e3759-b03f-4a74-ba1a-52aa92bb4abc tempest-ProjectMemberTests-1160045297 None] Created reservations ['f55569d0-5945-4922-8d88-f224924c93e8', '6e1cd4dd-2f09-4227-97f9-462911ce2ced', '91329783-5859-49a7-b881-f7c577d5499b', '5b34aae0-1317-402c-b2db-d4e17ef9d3aa'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:24 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-125e3759-b03f-4a74-ba1a-52aa92bb4abc tempest-ProjectMemberTests-1160045297 None] Delete snapshot completed successfully. Jul 07 17:45:24 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-125e3759-b03f-4a74-ba1a-52aa92bb4abc tempest-ProjectMemberTests-1160045297 None] Lock "cinder-8e6b1e76-f4c3-48f1-976c-b65fb4ddc450-delete_snapshot" released by "delete_snapshot" :: held 3.520s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-852f9581-77a0-4ae4-90a4-aa2518abb81f tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-ebde6d16-59d5-4828-80b6-d6f9209c266b-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-852f9581-77a0-4ae4-90a4-aa2518abb81f tempest-ProjectMemberTests-1160045297 None] Lock "cinder-ebde6d16-59d5-4828-80b6-d6f9209c266b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-852f9581-77a0-4ae4-90a4-aa2518abb81f tempest-ProjectMemberTests-1160045297 None] Acquiring lock "cinder-quobyte-ebde6d16-59d5-4828-80b6-d6f9209c266b" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:25 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-852f9581-77a0-4ae4-90a4-aa2518abb81f tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-ebde6d16-59d5-4828-80b6-d6f9209c266b" acquired by "delete_volume" :: waited 0.020s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:25 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97ec9f6-a285-49cf-a064-0315a96b8c59]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:25 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-852f9581-77a0-4ae4-90a4-aa2518abb81f tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:25 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b Jul 07 17:45:25 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:26 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-852f9581-77a0-4ae4-90a4-aa2518abb81f tempest-ProjectMemberTests-1160045297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b" returned: 0 in 0.866s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:26 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-852f9581-77a0-4ae4-90a4-aa2518abb81f tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:26 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b Jul 07 17:45:26 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:27 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-852f9581-77a0-4ae4-90a4-aa2518abb81f tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-ebde6d16-59d5-4828-80b6-d6f9209c266b" returned: 0 in 0.708s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:27 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-852f9581-77a0-4ae4-90a4-aa2518abb81f tempest-ProjectMemberTests-1160045297 None] Lock "cinder-quobyte-ebde6d16-59d5-4828-80b6-d6f9209c266b" released by "delete_volume" :: held 1.656s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:27 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-852f9581-77a0-4ae4-90a4-aa2518abb81f tempest-ProjectMemberTests-1160045297 None] Created reservations ['89639834-1e30-4ce3-a8c2-9545b996e6e5', '4a476e3d-1e85-4b8a-903c-4cec344779a6', '88d3f03c-fde5-488b-a316-396b620f6f46', '2adedfbd-5008-477f-802b-3999c40c1b57'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-852f9581-77a0-4ae4-90a4-aa2518abb81f tempest-ProjectMemberTests-1160045297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-852f9581-77a0-4ae4-90a4-aa2518abb81f tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-852f9581-77a0-4ae4-90a4-aa2518abb81f tempest-ProjectMemberTests-1160045297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:27 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-852f9581-77a0-4ae4-90a4-aa2518abb81f tempest-ProjectMemberTests-1160045297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-852f9581-77a0-4ae4-90a4-aa2518abb81f tempest-ProjectMemberTests-1160045297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:27 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-852f9581-77a0-4ae4-90a4-aa2518abb81f tempest-ProjectMemberTests-1160045297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:27 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:45:27 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:28 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-852f9581-77a0-4ae4-90a4-aa2518abb81f tempest-ProjectMemberTests-1160045297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.779s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:28 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-852f9581-77a0-4ae4-90a4-aa2518abb81f tempest-ProjectMemberTests-1160045297 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:45:28 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-852f9581-77a0-4ae4-90a4-aa2518abb81f tempest-ProjectMemberTests-1160045297 None] Deleted volume successfully. Jul 07 17:45:28 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-852f9581-77a0-4ae4-90a4-aa2518abb81f tempest-ProjectMemberTests-1160045297 None] Lock "cinder-ebde6d16-59d5-4828-80b6-d6f9209c266b-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:37 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:DELETE=2,cinder:SELECT=29,cinder:INSERT=7,cinder:UPDATE=30 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:45:38 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=20,cinder:INSERT=12,cinder:UPDATE=34,cinder:DELETE=3 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:45:49 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:45:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Flow 'volume_create_manager' (50bd7fa3-9ea2-491f-b039-cf630069169d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3b3fa4-33ff-423e-9258-350832b94987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3b3fa4-33ff-423e-9258-350832b94987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-753828172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02b64714-fb9a-436f-b188-feb445c189de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='311f60d9c3344c87b471d5e6c05897a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:49Z,use_quota=True,user_id='65a7f06658de42fea93574e9be275957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37cac980-ee37-47aa-ad40-2f586db2640d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37cac980-ee37-47aa-ad40-2f586db2640d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b96d57-1073-41c5-8b1c-d2b9d3865f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b96d57-1073-41c5-8b1c-d2b9d3865f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02b64714-fb9a-436f-b188-feb445c189de', 'volume_name': 'volume-02b64714-fb9a-436f-b188-feb445c189de', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b5649b-f2bb-46b1-b7da-acbb57c5b51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b5649b-f2bb-46b1-b7da-acbb57c5b51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:49 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7567dd9-e9d9-4275-8ccc-8789c2625384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:49 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Volume 02b64714-fb9a-436f-b188-feb445c189de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02b64714-fb9a-436f-b188-feb445c189de', 'volume_size': 1} Jul 07 17:45:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-753828172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02b64714-fb9a-436f-b188-feb445c189de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='311f60d9c3344c87b471d5e6c05897a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:49Z,use_quota=True,user_id='65a7f06658de42fea93574e9be275957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:45:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Creating volume 02b64714-fb9a-436f-b188-feb445c189de {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:45:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:49 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:45:49 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:45:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-02b64714-fb9a-436f-b188-feb445c189de 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:49 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-02b64714-fb9a-436f-b188-feb445c189de 1073741824 Jul 07 17:45:49 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:49 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:49 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-02b64714-fb9a-436f-b188-feb445c189de 1073741824" returned: 0 in 0.872s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-02b64714-fb9a-436f-b188-feb445c189de {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:50 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-02b64714-fb9a-436f-b188-feb445c189de Jul 07 17:45:50 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:50 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-02b64714-fb9a-436f-b188-feb445c189de" returned: 0 in 0.705s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:50 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:45:50 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7567dd9-e9d9-4275-8ccc-8789c2625384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02b64714-fb9a-436f-b188-feb445c189de', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0e0397-3b27-47bb-9b4f-c06c8235f7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:50 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Volume volume-02b64714-fb9a-436f-b188-feb445c189de (02b64714-fb9a-436f-b188-feb445c189de): created successfully Jul 07 17:45:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0e0397-3b27-47bb-9b4f-c06c8235f7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:50 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Flow 'volume_create_manager' (50bd7fa3-9ea2-491f-b039-cf630069169d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:50 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-d6e6ef93-819a-4447-9d78-f82bdd5dfb57 tempest-ProjectReaderTests-1184968008 None] Created volume successfully. Jul 07 17:45:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-92fa6b3e-5dda-4c5d-ba94-a7c3bd0f4853 tempest-ProjectReaderTests-1184968008 None] Acquiring lock "cinder-02b64714-fb9a-436f-b188-feb445c189de-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-92fa6b3e-5dda-4c5d-ba94-a7c3bd0f4853 tempest-ProjectReaderTests-1184968008 None] Lock "cinder-02b64714-fb9a-436f-b188-feb445c189de-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-92fa6b3e-5dda-4c5d-ba94-a7c3bd0f4853 tempest-ProjectReaderTests-1184968008 None] Acquiring lock "cinder-quobyte-02b64714-fb9a-436f-b188-feb445c189de" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:51 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-92fa6b3e-5dda-4c5d-ba94-a7c3bd0f4853 tempest-ProjectReaderTests-1184968008 None] Lock "cinder-quobyte-02b64714-fb9a-436f-b188-feb445c189de" acquired by "delete_volume" :: waited 0.015s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:51 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b2a7e5-b452-4928-bfa7-b7ad13568e86]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:51 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-92fa6b3e-5dda-4c5d-ba94-a7c3bd0f4853 tempest-ProjectReaderTests-1184968008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-02b64714-fb9a-436f-b188-feb445c189de {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:51 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-02b64714-fb9a-436f-b188-feb445c189de Jul 07 17:45:51 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:52 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-92fa6b3e-5dda-4c5d-ba94-a7c3bd0f4853 tempest-ProjectReaderTests-1184968008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-02b64714-fb9a-436f-b188-feb445c189de" returned: 0 in 0.777s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-92fa6b3e-5dda-4c5d-ba94-a7c3bd0f4853 tempest-ProjectReaderTests-1184968008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-02b64714-fb9a-436f-b188-feb445c189de {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:52 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-02b64714-fb9a-436f-b188-feb445c189de Jul 07 17:45:52 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:52 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:52 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-92fa6b3e-5dda-4c5d-ba94-a7c3bd0f4853 tempest-ProjectReaderTests-1184968008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-02b64714-fb9a-436f-b188-feb445c189de" returned: 0 in 0.691s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:52 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-92fa6b3e-5dda-4c5d-ba94-a7c3bd0f4853 tempest-ProjectReaderTests-1184968008 None] Lock "cinder-quobyte-02b64714-fb9a-436f-b188-feb445c189de" released by "delete_volume" :: held 1.516s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:52 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-92fa6b3e-5dda-4c5d-ba94-a7c3bd0f4853 tempest-ProjectReaderTests-1184968008 None] Created reservations ['47e30432-d9ea-4270-bfa2-69a0a5b09e16', 'f8b6f27e-9c17-48d5-9daf-f0017b19e826', 'ef184f38-9324-444b-bcf0-90d365cfc42d', '19f3e026-84c9-48d2-81c0-a5372bdd8adc'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-92fa6b3e-5dda-4c5d-ba94-a7c3bd0f4853 tempest-ProjectReaderTests-1184968008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-92fa6b3e-5dda-4c5d-ba94-a7c3bd0f4853 tempest-ProjectReaderTests-1184968008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:53 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-92fa6b3e-5dda-4c5d-ba94-a7c3bd0f4853 tempest-ProjectReaderTests-1184968008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:53 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-92fa6b3e-5dda-4c5d-ba94-a7c3bd0f4853 tempest-ProjectReaderTests-1184968008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-92fa6b3e-5dda-4c5d-ba94-a7c3bd0f4853 tempest-ProjectReaderTests-1184968008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-92fa6b3e-5dda-4c5d-ba94-a7c3bd0f4853 tempest-ProjectReaderTests-1184968008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:53 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:45:53 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:53 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:53 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-92fa6b3e-5dda-4c5d-ba94-a7c3bd0f4853 tempest-ProjectReaderTests-1184968008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.707s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:53 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-92fa6b3e-5dda-4c5d-ba94-a7c3bd0f4853 tempest-ProjectReaderTests-1184968008 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:45:53 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-92fa6b3e-5dda-4c5d-ba94-a7c3bd0f4853 tempest-ProjectReaderTests-1184968008 None] Deleted volume successfully. Jul 07 17:45:53 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-92fa6b3e-5dda-4c5d-ba94-a7c3bd0f4853 tempest-ProjectReaderTests-1184968008 None] Lock "cinder-02b64714-fb9a-436f-b188-feb445c189de-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:54 devstack cinder-volume[87303]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87303) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:45:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Flow 'volume_create_manager' (61f2debf-a953-401b-910a-36fd7645afed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ef1879-5fa9-4685-8747-6b635220539b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ef1879-5fa9-4685-8747-6b635220539b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2064189991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7617e8d5-f6ef-4150-8b87-7e4bb20ee760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='311f60d9c3344c87b471d5e6c05897a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:54Z,use_quota=True,user_id='65a7f06658de42fea93574e9be275957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc0d3a8-506e-4afb-a01b-008399703460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc0d3a8-506e-4afb-a01b-008399703460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd81ee3b-46b1-441b-ab9f-8d2bb7673a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd81ee3b-46b1-441b-ab9f-8d2bb7673a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7617e8d5-f6ef-4150-8b87-7e4bb20ee760', 'volume_name': 'volume-7617e8d5-f6ef-4150-8b87-7e4bb20ee760', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8371abe9-bd56-4338-ad49-46a761bdc072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8371abe9-bd56-4338-ad49-46a761bdc072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:54 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d50b244-753f-4818-83f4-51ff7774dc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:54 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Volume 7617e8d5-f6ef-4150-8b87-7e4bb20ee760: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7617e8d5-f6ef-4150-8b87-7e4bb20ee760', 'volume_size': 1} Jul 07 17:45:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:54 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2064189991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7617e8d5-f6ef-4150-8b87-7e4bb20ee760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='311f60d9c3344c87b471d5e6c05897a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:45:54Z,use_quota=True,user_id='65a7f06658de42fea93574e9be275957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb873dea-88fe-444c-92ac-18eec4b76124),volume_type_id=bb873dea-88fe-444c-92ac-18eec4b76124)}" {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:45:54 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.remotefs [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Creating volume 7617e8d5-f6ef-4150-8b87-7e4bb20ee760 {{(pid=87303) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:45:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:54 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:54 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:54 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Selected osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 as target Quobyte volume. {{(pid=87303) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:45:54 devstack cinder-volume[87303]: INFO cinder.volume.drivers.remotefs [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] casted to osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2 Jul 07 17:45:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7617e8d5-f6ef-4150-8b87-7e4bb20ee760 1073741824 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:54 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7617e8d5-f6ef-4150-8b87-7e4bb20ee760 1073741824 Jul 07 17:45:54 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:54 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:54 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7617e8d5-f6ef-4150-8b87-7e4bb20ee760 1073741824" returned: 0 in 0.838s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7617e8d5-f6ef-4150-8b87-7e4bb20ee760 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:55 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7617e8d5-f6ef-4150-8b87-7e4bb20ee760 Jul 07 17:45:55 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:55 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7617e8d5-f6ef-4150-8b87-7e4bb20ee760" returned: 0 in 0.650s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:55 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'} {{(pid=87303) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:45:55 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d50b244-753f-4818-83f4-51ff7774dc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7617e8d5-f6ef-4150-8b87-7e4bb20ee760', 'volume_size': 1}' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e134f07-cfbf-4ad7-b0c2-84cc5202671b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:45:55 devstack cinder-volume[87303]: INFO cinder.volume.flows.manager.create_volume [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Volume volume-7617e8d5-f6ef-4150-8b87-7e4bb20ee760 (7617e8d5-f6ef-4150-8b87-7e4bb20ee760): created successfully Jul 07 17:45:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e134f07-cfbf-4ad7-b0c2-84cc5202671b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87303) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:45:55 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Flow 'volume_create_manager' (61f2debf-a953-401b-910a-36fd7645afed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87303) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:45:55 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-6b80e3c4-6f46-4814-a52c-860574501ad0 tempest-ProjectReaderTests-1184968008 None] Created volume successfully. Jul 07 17:45:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-68ca69b2-fab7-4170-aa66-880a34cfabe2 tempest-ProjectReaderTests-1184968008 None] Acquiring lock "cinder-7617e8d5-f6ef-4150-8b87-7e4bb20ee760-delete_volume" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-68ca69b2-fab7-4170-aa66-880a34cfabe2 tempest-ProjectReaderTests-1184968008 None] Lock "cinder-7617e8d5-f6ef-4150-8b87-7e4bb20ee760-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-68ca69b2-fab7-4170-aa66-880a34cfabe2 tempest-ProjectReaderTests-1184968008 None] Acquiring lock "cinder-quobyte-7617e8d5-f6ef-4150-8b87-7e4bb20ee760" by "delete_volume" {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:45:56 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-68ca69b2-fab7-4170-aa66-880a34cfabe2 tempest-ProjectReaderTests-1184968008 None] Lock "cinder-quobyte-7617e8d5-f6ef-4150-8b87-7e4bb20ee760" acquired by "delete_volume" :: waited 0.023s {{(pid=87303) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:45:56 devstack cinder-volume[87303]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce4df23-c75b-4719-945c-2abbc67a1961]: (4, 'qcow2') {{(pid=88432) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:45:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-68ca69b2-fab7-4170-aa66-880a34cfabe2 tempest-ProjectReaderTests-1184968008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7617e8d5-f6ef-4150-8b87-7e4bb20ee760 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:56 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7617e8d5-f6ef-4150-8b87-7e4bb20ee760 Jul 07 17:45:56 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:56 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:45:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:56 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:56 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:56 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:45:56 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:57 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-68ca69b2-fab7-4170-aa66-880a34cfabe2 tempest-ProjectReaderTests-1184968008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7617e8d5-f6ef-4150-8b87-7e4bb20ee760" returned: 0 in 0.836s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-68ca69b2-fab7-4170-aa66-880a34cfabe2 tempest-ProjectReaderTests-1184968008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7617e8d5-f6ef-4150-8b87-7e4bb20ee760 {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:57 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7617e8d5-f6ef-4150-8b87-7e4bb20ee760 Jul 07 17:45:57 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:57 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.711s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:57 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:45:57 devstack cinder-volume[87303]: DEBUG oslo_service.periodic_task [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] Running periodic task VolumeManager._thread_info {{(pid=87303) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:45:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread count: 28 {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:45:57 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-83506904-fa75-46d4-a270-be4ea4915b74 None None] thread info: [<_MainThread(MainThread, started 140386906886272)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87303) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:45:57 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-68ca69b2-fab7-4170-aa66-880a34cfabe2 tempest-ProjectReaderTests-1184968008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c/volume-7617e8d5-f6ef-4150-8b87-7e4bb20ee760" returned: 0 in 0.661s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:57 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-68ca69b2-fab7-4170-aa66-880a34cfabe2 tempest-ProjectReaderTests-1184968008 None] Lock "cinder-quobyte-7617e8d5-f6ef-4150-8b87-7e4bb20ee760" released by "delete_volume" :: held 1.545s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:45:57 devstack cinder-volume[87303]: DEBUG cinder.quota [None req-68ca69b2-fab7-4170-aa66-880a34cfabe2 tempest-ProjectReaderTests-1184968008 None] Created reservations ['1454bd34-273d-46ec-81f6-0fb7f774eff9', 'd5c09bb6-ebc2-42f5-9322-c226d36b5bb5', 'a6c326e5-7344-4609-a973-255e107c03d4', '525b97ce-acce-4323-95b0-9dd196b8ec5a'] {{(pid=87303) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:45:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-68ca69b2-fab7-4170-aa66-880a34cfabe2 tempest-ProjectReaderTests-1184968008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:45:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-68ca69b2-fab7-4170-aa66-880a34cfabe2 tempest-ProjectReaderTests-1184968008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:45:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-68ca69b2-fab7-4170-aa66-880a34cfabe2 tempest-ProjectReaderTests-1184968008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2': None} {{(pid=87303) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:45:57 devstack cinder-volume[87303]: DEBUG cinder.volume.drivers.quobyte [None req-68ca69b2-fab7-4170-aa66-880a34cfabe2 tempest-ProjectReaderTests-1184968008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab66acf9-894c-4fb7-8434-603bbb6db4b2'] {{(pid=87303) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:45:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-68ca69b2-fab7-4170-aa66-880a34cfabe2 tempest-ProjectReaderTests-1184968008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87303) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:45:57 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-68ca69b2-fab7-4170-aa66-880a34cfabe2 tempest-ProjectReaderTests-1184968008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:57 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c Jul 07 17:45:57 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:58 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:58 devstack cinder-volume[87303]: DEBUG oslo_concurrency.processutils [None req-68ca69b2-fab7-4170-aa66-880a34cfabe2 tempest-ProjectReaderTests-1184968008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1600ab315be9182a3067cb24b11b4f9c" returned: 0 in 0.683s {{(pid=87303) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:58 devstack cinder-volume[87303]: DEBUG cinder.manager [None req-68ca69b2-fab7-4170-aa66-880a34cfabe2 tempest-ProjectReaderTests-1184968008 None] Notifying Schedulers of capabilities ... {{(pid=87303) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:45:58 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-68ca69b2-fab7-4170-aa66-880a34cfabe2 tempest-ProjectReaderTests-1184968008 None] Deleted volume successfully. Jul 07 17:45:58 devstack cinder-volume[87303]: DEBUG cinder.coordination [None req-68ca69b2-fab7-4170-aa66-880a34cfabe2 tempest-ProjectReaderTests-1184968008 None] Lock "cinder-7617e8d5-f6ef-4150-8b87-7e4bb20ee760-delete_volume" released by "delete_volume" :: held 2.455s {{(pid=87303) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:46:11 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=20,cinder:UPDATE=18,cinder:DELETE=2,cinder:INSERT=5 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:46:11 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:UPDATE=27,cinder:INSERT=5,cinder:SELECT=9,cinder:DELETE=2 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}